[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:23 dist-test-slave-tm1g krb5kdc[12746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:23 dist-test-slave-tm1g krb5kdc[12746](info): set up 2 sockets
Aug 07 22:47:23 dist-test-slave-tm1g krb5kdc[12746](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 22:47:24.824280 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.009s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:24 dist-test-slave-tm1g krb5kdc[12746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:47:24.954772 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36193
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:39471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:36193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:25.069540 12759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:25.069875 12759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:25.069957 12759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:25.074047 12759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:25.074157 12759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:25.074195 12759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:25.074234 12759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:25.074275 12759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:25.079697 12759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:39471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:36193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:25.080922 12759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:25.082031 12759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:25.091400 12765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:25.091372 12767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:25.091377 12764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:25.091724 12759 server_base.cc:1034] running on GCE node
I20260807 22:47:25.092322 12759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:25.093492 12759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:25.094695 12759 hybrid_clock.cc:648] HybridClock initialized: now 1786142845094649 us; error 57 us; skew 500 ppm
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:25.097608 12759 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:47:25.098661 12759 webserver.cc:460] Webserver started at http://127.12.112.254:33923/ using document root <none> and password file <none>
I20260807 22:47:25.099205 12759 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:25.099264 12759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:25.099449 12759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:25.101538 12759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "533873f1bfa06e1182b785dabc29fb57"
server_key_iv: "d337cf175091cd6f25434309aa5dc4e8"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.102053 12759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "533873f1bfa06e1182b785dabc29fb57"
server_key_iv: "d337cf175091cd6f25434309aa5dc4e8"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.105867 12759 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 22:47:25.108371 12774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:25.109596 12759 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:25.109699 12759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "533873f1bfa06e1182b785dabc29fb57"
server_key_iv: "d337cf175091cd6f25434309aa5dc4e8"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.109791 12759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:25.123965 12759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:25.126797 12759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:25.126968 12759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:25.134549 12759 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:36193
I20260807 22:47:25.134588 12827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:36193 every 8 connection(s)
I20260807 22:47:25.135540 12759 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:25.138340 12828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:25.142256 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 12759
I20260807 22:47:25.142470 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:25.144119 12739 external_mini_cluster.cc:1428] Setting key 791259db958a443ba89daff09603d17d
I20260807 22:47:25.144747 12828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f: Bootstrap starting.
I20260807 22:47:25.147779 12828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:25.148579 12828 log.cc:824] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:25.150583 12828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f: No bootstrap required, opened a new log
I20260807 22:47:25.154714 12828 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36193 } }
I20260807 22:47:25.154966 12828 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:25.155045 12828 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77304bf6bf8b4a97be4c49bc01ed3d3f, State: Initialized, Role: FOLLOWER
I20260807 22:47:25.155516 12828 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36193 } }
I20260807 22:47:25.155668 12828 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:25.155738 12828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:25.155869 12828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:25.156791 12828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36193 } }
I20260807 22:47:25.157162 12828 leader_election.cc:302] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77304bf6bf8b4a97be4c49bc01ed3d3f; no voters:
I20260807 22:47:25.157509 12828 leader_election.cc:288] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:25.157614 12833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:25.157853 12833 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [term 1 LEADER]: Becoming Leader. State: Replica: 77304bf6bf8b4a97be4c49bc01ed3d3f, State: Running, Role: LEADER
I20260807 22:47:25.158157 12833 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36193 } }
I20260807 22:47:25.158830 12828 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:25.160334 12834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36193 } } }
I20260807 22:47:25.160470 12834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:25.160748 12835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77304bf6bf8b4a97be4c49bc01ed3d3f. Latest consensus state: current_term: 1 leader_uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77304bf6bf8b4a97be4c49bc01ed3d3f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36193 } } }
I20260807 22:47:25.160842 12835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:25.161171 12842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:25.164587 12842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:25.170054 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:25.147728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60678 (local address 127.12.112.254:36193)
0807 22:47:25.148270 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:25.148292 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:25.149412 (+ 1120us) server_negotiation.cc:407] Connection header received
0807 22:47:25.152684 (+ 3272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:25.152699 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:25.153000 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:25.153321 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:25.155664 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.156803 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.158626 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.159373 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.159555 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:25.164491 (+ 4936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:25.164497 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:25.164508 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:25.164537 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:25.166453 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.167033 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.167039 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.167042 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.167152 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.167520 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.167528 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.167529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.167999 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:25.168214 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:25.168807 (+ 593us) server_negotiation.cc:299] Negotiation successful
0807 22:47:25.169084 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":162,"threads_started":1}
I20260807 22:47:25.171331 12842 catalog_manager.cc:1347] Generated new cluster ID: 7f15a6068a13441485e431b211f6e7a7
I20260807 22:47:25.171391 12842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:25.200124 12842 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:25.201435 12842 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:25.206691 12842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77304bf6bf8b4a97be4c49bc01ed3d3f: Generated new TSK 0
I20260807 22:47:25.207494 12842 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:47:25.237900 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:39471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:25.350487 12854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:25.350826 12854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:25.350910 12854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:25.355396 12854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:25.355453 12854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:25.355546 12854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:25.360882 12854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:39471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36193
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:25.361927 12854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:25.363027 12854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:25.372730 12859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:25.372735 12861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:25.372771 12854 server_base.cc:1034] running on GCE node
W20260807 22:47:25.372735 12863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:25.373307 12854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:25.373950 12854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:25.375113 12854 hybrid_clock.cc:648] HybridClock initialized: now 1786142845375094 us; error 31 us; skew 500 ppm
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:25.377782 12854 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:47:25.378702 12854 webserver.cc:460] Webserver started at http://127.12.112.193:43451/ using document root <none> and password file <none>
I20260807 22:47:25.379264 12854 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:25.379360 12854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:25.379606 12854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:25.381640 12854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "07fe78971ce44b6a97fac5cfb9db37cc"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "e3c07cf726bc9618767ffb6126ce7b16"
server_key_iv: "4dfaae01895140e2c12624dfba8186f8"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.382232 12854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "07fe78971ce44b6a97fac5cfb9db37cc"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "e3c07cf726bc9618767ffb6126ce7b16"
server_key_iv: "4dfaae01895140e2c12624dfba8186f8"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.385898 12854 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:47:25.388381 12871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:25.389564 12854 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:25.389701 12854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "07fe78971ce44b6a97fac5cfb9db37cc"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "e3c07cf726bc9618767ffb6126ce7b16"
server_key_iv: "4dfaae01895140e2c12624dfba8186f8"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.389822 12854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:25.416848 12854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:25.419768 12854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:25.419981 12854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:25.420594 12854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:25.421455 12854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:25.421525 12854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:25.421595 12854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:25.421646 12854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:25.430753 12854 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:36675
I20260807 22:47:25.430783 12988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:36675 every 8 connection(s)
I20260807 22:47:25.431696 12854 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:25.434590 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 12854
I20260807 22:47:25.434695 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:25.434976 12739 external_mini_cluster.cc:1428] Setting key c9ea56dd0c96bc325c55d14b0ce4513c
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:47:25.446796 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:25.433636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:44869 (local address 127.12.112.254:36193)
0807 22:47:25.433784 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:25.433790 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:25.434735 (+ 945us) server_negotiation.cc:407] Connection header received
0807 22:47:25.436243 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:25.436247 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:25.436304 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:25.436408 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:25.437573 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.438120 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.439325 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.439735 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.439859 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:25.442684 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:25.442692 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:25.442697 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:25.442731 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:25.444399 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.444950 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.444956 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.444960 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.445056 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.445504 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.445510 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.445513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.445777 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:25.445888 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:25.446501 (+ 613us) server_negotiation.cc:299] Negotiation successful
0807 22:47:25.446658 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:47:25.447546 12991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:25.434025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36193 (local address 127.12.112.193:44869)
0807 22:47:25.434565 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:25.434609 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:25.436031 (+ 1422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:25.436595 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:25.436601 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:25.436949 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:25.437407 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:25.437419 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.438248 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.438252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:25.439195 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:25.439205 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.439896 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.439899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:25.440049 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:25.440649 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:25.440665 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:25.442513 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:25.444558 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:25.444563 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:25.444574 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:25.444817 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:25.445185 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:25.445187 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:25.445189 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:25.445378 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:25.445891 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:25.445896 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:25.446116 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 22:47:25.446278 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 22:47:25.446606 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":117,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:47:25.448802 12989 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36193
I20260807 22:47:25.449039 12989 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:25.449530 12989 heartbeater.cc:511] Master 127.12.112.254:36193 requested a full tablet report, sending...
I20260807 22:47:25.451242 12791 ts_manager.cc:194] Registered new tserver with Master: 07fe78971ce44b6a97fac5cfb9db37cc (127.12.112.193:36675)
I20260807 22:47:25.452912 12791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:44869
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:47:25.464653 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:39471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:25.578670 12994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:25.578935 12994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:25.578981 12994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:25.583109 12994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:25.583174 12994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:25.583236 12994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:25.588575 12994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:39471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36193
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:25.589643 12994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:25.590795 12994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:25.600605 13000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:25.600601 13002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:25.600620 12999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:25.600952 12994 server_base.cc:1034] running on GCE node
I20260807 22:47:25.601368 12994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:25.602065 12994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:25.603253 12994 hybrid_clock.cc:648] HybridClock initialized: now 1786142845603228 us; error 41 us; skew 500 ppm
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:25.606029 12994 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:47:25.606951 12994 webserver.cc:460] Webserver started at http://127.12.112.194:39709/ using document root <none> and password file <none>
I20260807 22:47:25.607484 12994 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:25.607545 12994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:25.607719 12994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:25.609887 12994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "9836ab09a02e4ac69701a6b93e6480db"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "d6a693144a4f709b50f926ba401e074f"
server_key_iv: "30d0363da198598049230480458cdc90"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.610487 12994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "9836ab09a02e4ac69701a6b93e6480db"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "d6a693144a4f709b50f926ba401e074f"
server_key_iv: "30d0363da198598049230480458cdc90"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.614212 12994 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:47:25.616793 13009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:25.618067 12994 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:25.618163 12994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "9836ab09a02e4ac69701a6b93e6480db"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "d6a693144a4f709b50f926ba401e074f"
server_key_iv: "30d0363da198598049230480458cdc90"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.618247 12994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:25.632277 12994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:25.635444 12994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:25.635608 12994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:25.636165 12994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:25.636956 12994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:25.637002 12994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:25.637043 12994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:25.637059 12994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:25.646209 12994 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:33153
I20260807 22:47:25.646238 13126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:33153 every 8 connection(s)
I20260807 22:47:25.647197 12994 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:25.651135 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 12994
I20260807 22:47:25.651273 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:25.651559 12739 external_mini_cluster.cc:1428] Setting key fc8cb93e60655ab17ad30c906a342d65
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:47:25.663034 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:25.649162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:42979 (local address 127.12.112.254:36193)
0807 22:47:25.649354 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:25.649358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:25.650220 (+ 862us) server_negotiation.cc:407] Connection header received
0807 22:47:25.651820 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:25.651824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:25.651884 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:25.651975 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:25.653531 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.654395 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.655597 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.655831 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.655950 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:25.658761 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:25.658765 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:25.658769 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:25.658808 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:25.660730 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.661343 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.661348 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.661350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.661443 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.661774 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.661777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.661780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.662063 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:25.662173 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:25.662719 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 22:47:25.662844 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 22:47:25.663851 13129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:25.649593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36193 (local address 127.12.112.194:42979)
0807 22:47:25.650061 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:25.650104 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:25.651552 (+ 1448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:25.652182 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:25.652192 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:25.652700 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:25.653379 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:25.653395 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.654515 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.654517 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:25.655465 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:25.655474 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.655990 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.655994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:25.656166 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:25.656790 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:25.656808 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:25.658574 (+ 1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:25.660894 (+ 2320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:25.660903 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:25.660922 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:25.661240 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:25.661541 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:25.661543 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:25.661544 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:25.661672 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:25.662176 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:25.662181 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:25.662481 (+ 300us) client_negotiation.cc:769] Sending connection context
0807 22:47:25.662673 (+ 192us) client_negotiation.cc:240] Negotiation successful
0807 22:47:25.662998 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":111,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:47:25.665155 13127 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36193
I20260807 22:47:25.665424 13127 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:25.665923 13127 heartbeater.cc:511] Master 127.12.112.254:36193 requested a full tablet report, sending...
I20260807 22:47:25.667037 12791 ts_manager.cc:194] Registered new tserver with Master: 9836ab09a02e4ac69701a6b93e6480db (127.12.112.194:33153)
I20260807 22:47:25.667623 12791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:42979
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:47:25.679293 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:39471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:25.797609 13132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:25.797858 13132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:25.797912 13132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:25.802016 13132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:25.802071 13132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:25.802130 13132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:25.807396 13132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:39471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36193
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:25.808452 13132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:25.809500 13132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:25.819523 13138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:25.819518 13140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:25.819525 13137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:25.819795 13132 server_base.cc:1034] running on GCE node
I20260807 22:47:25.820319 13132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:25.820996 13132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:25.822216 13132 hybrid_clock.cc:648] HybridClock initialized: now 1786142845822197 us; error 40 us; skew 500 ppm
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:25.824956 13132 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:47:25.825805 13132 webserver.cc:460] Webserver started at http://127.12.112.195:45825/ using document root <none> and password file <none>
I20260807 22:47:25.826427 13132 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:25.826494 13132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:25.826737 13132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:25.828801 13132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "bc70e5f711f8446b94326161c1501eda"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "18532591a77ca035ddb0454f76209161"
server_key_iv: "147b9918aa99e37c36a778336276549e"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.829383 13132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "bc70e5f711f8446b94326161c1501eda"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "18532591a77ca035ddb0454f76209161"
server_key_iv: "147b9918aa99e37c36a778336276549e"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.833163 13132 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 22:47:25.835640 13147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:25.836829 13132 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:25.836961 13132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "bc70e5f711f8446b94326161c1501eda"
format_stamp: "Formatted at 2026-08-07 22:47:25 on dist-test-slave-tm1g"
server_key: "18532591a77ca035ddb0454f76209161"
server_key_iv: "147b9918aa99e37c36a778336276549e"
server_key_version: "encryptionkey@0"
I20260807 22:47:25.837075 13132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:25.856932 13132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:25.860347 13132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:25.860561 13132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:25.861138 13132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:25.862033 13132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:25.862079 13132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:25.862118 13132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:25.862134 13132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:25.870968 13132 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:46843
I20260807 22:47:25.870997 13262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:46843 every 8 connection(s)
I20260807 22:47:25.871932 13132 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:47:25.880956 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 13132
I20260807 22:47:25.881059 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:25.881354 12739 external_mini_cluster.cc:1428] Setting key 32790fbb8d568a1ff79a6f655c0abb4b
I20260807 22:47:25.885915 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:25.873775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:37923 (local address 127.12.112.254:36193)
0807 22:47:25.873937 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:25.873941 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:25.874818 (+ 877us) server_negotiation.cc:407] Connection header received
0807 22:47:25.876036 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:25.876038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:25.876087 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:25.876162 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:25.877294 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.877822 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.878987 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.879217 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.879384 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:25.881973 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:25.881976 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:25.881979 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:25.882033 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:25.883665 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.884301 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.884307 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.884310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.884403 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.884752 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.884757 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.884759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.884971 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:25.885082 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:25.885606 (+ 524us) server_negotiation.cc:299] Negotiation successful
0807 22:47:25.885732 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:47:25.886874 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:25.874152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36193 (local address 127.12.112.195:37923)
0807 22:47:25.874659 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:25.874702 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:25.875834 (+ 1132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:25.876321 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:25.876327 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:25.876685 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:25.877164 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:25.877176 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.877945 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.877948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:25.878848 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:25.878857 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.879403 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.879407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:25.879549 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:25.880097 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:25.880113 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:25.881749 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:25.883843 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:25.883848 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:25.883869 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:25.884210 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:25.884498 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:25.884503 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:25.884505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:25.884655 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:25.885080 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:25.885087 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:25.885351 (+ 264us) client_negotiation.cc:769] Sending connection context
0807 22:47:25.885551 (+ 200us) client_negotiation.cc:240] Negotiation successful
0807 22:47:25.885876 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":170,"threads_started":1}
I20260807 22:47:25.888085 13263 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36193
I20260807 22:47:25.888356 13263 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:25.888888 13263 heartbeater.cc:511] Master 127.12.112.254:36193 requested a full tablet report, sending...
I20260807 22:47:25.889938 12791 ts_manager.cc:194] Registered new tserver with Master: bc70e5f711f8446b94326161c1501eda (127.12.112.195:46843)
I20260807 22:47:25.890597 12791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:37923
I20260807 22:47:25.896044 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:47:25.923949 13270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:25.914113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41834 (local address 127.12.112.193:36675)
0807 22:47:25.914477 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:25.914494 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:25.914523 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:47:25.914685 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:25.914692 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:25.914893 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:25.915045 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:25.915756 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.916567 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.917420 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.917813 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.917938 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:25.920421 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:25.920430 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:25.920443 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:25.920467 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:25.922166 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.922718 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.922723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.922725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.922805 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.923091 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.923093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.923094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.923327 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:25.923496 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:25.923661 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 22:47:25.923790 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":93,"threads_started":1}
W20260807 22:47:25.924925 12900 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41834
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:47:25 dist-test-slave-tm1g krb5kdc[12746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:47:25.952008 13270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:25.943513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41848 (local address 127.12.112.193:36675)
0807 22:47:25.943689 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:25.943694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:25.943817 (+ 123us) server_negotiation.cc:407] Connection header received
0807 22:47:25.944002 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:25.944005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:25.944059 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:25.944144 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:25.944846 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.945409 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.946253 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:25.946584 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:25.946695 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:25.949052 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:25.949055 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:25.949058 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:25.949092 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:25.950342 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.950765 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.950769 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.950770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.950859 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:25.951134 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:25.951138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:25.951140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:25.951314 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:25.951479 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:25.951720 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 22:47:25.951842 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 22:47:25.953137 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 12854
I20260807 22:47:25.961177 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 12994
I20260807 22:47:25.967264 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 13132
I20260807 22:47:25.974502 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 12759
2026-08-07T22:47:25Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2245 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:26 dist-test-slave-tm1g krb5kdc[13277](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:26 dist-test-slave-tm1g krb5kdc[13277](info): set up 2 sockets
Aug 07 22:47:26 dist-test-slave-tm1g krb5kdc[13277](info): commencing operation
krb5kdc: starting...
W20260807 22:47:27.047461 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:27 dist-test-slave-tm1g krb5kdc[13277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:47:27.173202 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36521
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:36521
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:27.284188 13290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:27.284487 13290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:27.284564 13290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:27.288625 13290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:27.288719 13290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:27.288759 13290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:27.288820 13290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:27.288861 13290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:27.294063 13290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:36521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:27.295235 13290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:27.296268 13290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:27.304689 13298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:27.304700 13295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:27.304908 13290 server_base.cc:1034] running on GCE node
W20260807 22:47:27.304700 13296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:27.305557 13290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:27.306743 13290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:27.307931 13290 hybrid_clock.cc:648] HybridClock initialized: now 1786142847307907 us; error 39 us; skew 500 ppm
Aug 07 22:47:27 dist-test-slave-tm1g krb5kdc[13277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142847, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:27.310752 13290 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:47:27.311614 13290 webserver.cc:460] Webserver started at http://127.12.112.254:35549/ using document root <none> and password file <none>
I20260807 22:47:27.312172 13290 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:27.312263 13290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:27.312500 13290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:27.314635 13290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "a7e0b349dfcc4609b41bb6ce702cc377"
format_stamp: "Formatted at 2026-08-07 22:47:27 on dist-test-slave-tm1g"
server_key: "dda712c906fc6b7573c4acc1b49afe89"
server_key_iv: "4883a7aa5d0183a5fadb2d65eb15467f"
server_key_version: "encryptionkey@0"
I20260807 22:47:27.315196 13290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "a7e0b349dfcc4609b41bb6ce702cc377"
format_stamp: "Formatted at 2026-08-07 22:47:27 on dist-test-slave-tm1g"
server_key: "dda712c906fc6b7573c4acc1b49afe89"
server_key_iv: "4883a7aa5d0183a5fadb2d65eb15467f"
server_key_version: "encryptionkey@0"
I20260807 22:47:27.318943 13290 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:47:27.321192 13305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:27.322469 13290 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:27.322608 13290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "a7e0b349dfcc4609b41bb6ce702cc377"
format_stamp: "Formatted at 2026-08-07 22:47:27 on dist-test-slave-tm1g"
server_key: "dda712c906fc6b7573c4acc1b49afe89"
server_key_iv: "4883a7aa5d0183a5fadb2d65eb15467f"
server_key_version: "encryptionkey@0"
I20260807 22:47:27.322721 13290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:27.340361 13290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:27.343658 13290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:27.343873 13290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:27.351001 13290 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:36521
I20260807 22:47:27.351065 13358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:36521 every 8 connection(s)
I20260807 22:47:27.352005 13290 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:27.354892 13359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:27.359689 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 13290
I20260807 22:47:27.359822 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:27.360067 12739 external_mini_cluster.cc:1428] Setting key f78d38e32cd6415f59ee86eb9eb0d4a3
I20260807 22:47:27.361809 13359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377: Bootstrap starting.
I20260807 22:47:27.364058 13359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:27.364794 13359 log.cc:824] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:27.367036 13359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377: No bootstrap required, opened a new log
Aug 07 22:47:27 dist-test-slave-tm1g krb5kdc[13277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:27.370949 13359 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e0b349dfcc4609b41bb6ce702cc377" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36521 } }
I20260807 22:47:27.371194 13359 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:27.371289 13359 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e0b349dfcc4609b41bb6ce702cc377, State: Initialized, Role: FOLLOWER
I20260807 22:47:27.371737 13359 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e0b349dfcc4609b41bb6ce702cc377" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36521 } }
I20260807 22:47:27.371898 13359 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:27.371984 13359 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:27.372102 13359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:27.372995 13359 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e0b349dfcc4609b41bb6ce702cc377" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36521 } }
I20260807 22:47:27.373389 13359 leader_election.cc:302] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7e0b349dfcc4609b41bb6ce702cc377; no voters:
I20260807 22:47:27.373759 13359 leader_election.cc:288] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:27.373950 13364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:27.374168 13364 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [term 1 LEADER]: Becoming Leader. State: Replica: a7e0b349dfcc4609b41bb6ce702cc377, State: Running, Role: LEADER
I20260807 22:47:27.374498 13364 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e0b349dfcc4609b41bb6ce702cc377" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36521 } }
I20260807 22:47:27.375032 13362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:27.361445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39112 (local address 127.12.112.254:36521)
0807 22:47:27.361904 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:27.361925 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:27.361969 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:47:27.362673 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:27.362691 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:27.363003 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:27.363330 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:27.364188 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:27.365370 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:27.366582 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:27.367039 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:27.367218 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:27.369684 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:27.369689 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:27.369702 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:27.369728 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:27.371746 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:27.372276 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:27.372282 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:27.372286 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:27.372409 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:27.372697 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:27.372701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:27.372703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:27.373098 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:27.373289 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:27.373632 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 22:47:27.373980 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":128,"threads_started":1}
I20260807 22:47:27.375075 13359 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:27.376093 13366 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7e0b349dfcc4609b41bb6ce702cc377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e0b349dfcc4609b41bb6ce702cc377" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36521 } } }
I20260807 22:47:27.376219 13366 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:27.376453 13366 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7e0b349dfcc4609b41bb6ce702cc377. Latest consensus state: current_term: 1 leader_uuid: "a7e0b349dfcc4609b41bb6ce702cc377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e0b349dfcc4609b41bb6ce702cc377" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36521 } } }
I20260807 22:47:27.376536 13366 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:27.377302 13374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:27.379871 13374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:27.384979 13374 catalog_manager.cc:1347] Generated new cluster ID: 46c1e12270d0466ca5b6ab900333aec0
I20260807 22:47:27.385039 13374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:27.399000 13374 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:27.400097 13374 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:27.404886 13374 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7e0b349dfcc4609b41bb6ce702cc377: Generated new TSK 0
I20260807 22:47:27.405543 13374 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:47:27.437327 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36521
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:27.581393 13387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:27.581651 13387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:27.581728 13387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:27.585878 13387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:27.585935 13387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:27.586035 13387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:27.591210 13387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36521
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:27.592279 13387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:27.593317 13387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:47:27.603307 13387 server_base.cc:1034] running on GCE node
W20260807 22:47:27.603276 13393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:27.603236 13395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:27.603463 13392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:27.603873 13387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:27.604530 13387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:27.605724 13387 hybrid_clock.cc:648] HybridClock initialized: now 1786142847605713 us; error 32 us; skew 500 ppm
Aug 07 22:47:27 dist-test-slave-tm1g krb5kdc[13277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142847, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:27.608585 13387 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:47:27.609385 13387 webserver.cc:460] Webserver started at http://127.12.112.193:36123/ using document root <none> and password file <none>
I20260807 22:47:27.609906 13387 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:27.609963 13387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:27.610127 13387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:27.612200 13387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf"
format_stamp: "Formatted at 2026-08-07 22:47:27 on dist-test-slave-tm1g"
server_key: "2f7cd25e58273d136de79aa5698e51bb"
server_key_iv: "78e3276a4fb301a66832b3e288d2c439"
server_key_version: "encryptionkey@0"
I20260807 22:47:27.612720 13387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf"
format_stamp: "Formatted at 2026-08-07 22:47:27 on dist-test-slave-tm1g"
server_key: "2f7cd25e58273d136de79aa5698e51bb"
server_key_iv: "78e3276a4fb301a66832b3e288d2c439"
server_key_version: "encryptionkey@0"
I20260807 22:47:27.616297 13387 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:47:27.618598 13403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:27.619772 13387 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:47:27.619894 13387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf"
format_stamp: "Formatted at 2026-08-07 22:47:27 on dist-test-slave-tm1g"
server_key: "2f7cd25e58273d136de79aa5698e51bb"
server_key_iv: "78e3276a4fb301a66832b3e288d2c439"
server_key_version: "encryptionkey@0"
I20260807 22:47:27.619997 13387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:27.645407 13387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:27.648777 13387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:27.649000 13387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:27.649669 13387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:27.650527 13387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:27.650580 13387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:27.650646 13387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:27.650681 13387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:27.659575 13387 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:43731
I20260807 22:47:27.659601 13518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:43731 every 8 connection(s)
I20260807 22:47:27.660523 13387 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:27.665354 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 13387
I20260807 22:47:27.665488 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:27.665796 12739 external_mini_cluster.cc:1428] Setting key 0556f874720d173947cdb08f43a47b91
Aug 07 22:47:27 dist-test-slave-tm1g krb5kdc[13277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142847, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:27.675480 13362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:27.662480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:43859 (local address 127.12.112.254:36521)
0807 22:47:27.662625 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:27.662628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:27.663415 (+ 787us) server_negotiation.cc:407] Connection header received
0807 22:47:27.664357 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:27.664360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:27.664427 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:27.664522 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:27.665751 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:27.666503 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:27.668221 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:27.668480 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:27.668564 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:27.671365 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:27.671372 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:27.671378 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:27.671413 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:27.673242 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:27.673774 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:27.673780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:27.673781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:27.673875 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:27.674212 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:27.674218 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:27.674222 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:27.674521 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:27.674656 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:27.675138 (+ 482us) server_negotiation.cc:299] Negotiation successful
0807 22:47:27.675276 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:47:27.676261 13521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:27.662800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36521 (local address 127.12.112.193:43859)
0807 22:47:27.663258 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:27.663302 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:27.664122 (+ 820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:27.664695 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:27.664701 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:27.665051 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:27.665597 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:27.665616 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:27.666652 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:27.666656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:27.668082 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:27.668097 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:27.668639 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:27.668645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:27.668883 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:27.669671 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:27.669688 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:27.671192 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:27.673385 (+ 2193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:27.673389 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:27.673400 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:27.673662 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:27.673974 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:27.673976 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:27.673985 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:27.674115 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:27.674660 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:27.674665 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:27.674893 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 22:47:27.675047 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 22:47:27.675289 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":107,"threads_started":1}
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:47:27.677591 13519 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36521
I20260807 22:47:27.677843 13519 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:27.678380 13519 heartbeater.cc:511] Master 127.12.112.254:36521 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:47:27.679886 13323 ts_manager.cc:194] Registered new tserver with Master: bd250fb9f03548908b3b3a8a4eb1e5bf (127.12.112.193:43731)
I20260807 22:47:27.681023 13323 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:43859
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:47:27.695066 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36521
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:27.810016 13524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:27.810333 13524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:27.810431 13524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:27.814471 13524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:27.814548 13524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:27.814639 13524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:27.819908 13524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36521
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:27.820998 13524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:27.822022 13524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:27.831951 13531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:27.832026 13530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:27.831949 13524 server_base.cc:1034] running on GCE node
W20260807 22:47:27.831964 13533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:27.832654 13524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:27.833277 13524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:27.834475 13524 hybrid_clock.cc:648] HybridClock initialized: now 1786142847834459 us; error 27 us; skew 500 ppm
Aug 07 22:47:27 dist-test-slave-tm1g krb5kdc[13277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142847, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:27.837333 13524 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:47:27.838209 13524 webserver.cc:460] Webserver started at http://127.12.112.194:44159/ using document root <none> and password file <none>
I20260807 22:47:27.838798 13524 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:27.838896 13524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:27.839131 13524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:27.841277 13524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "283569c98ff04f33beedd791aab4a118"
format_stamp: "Formatted at 2026-08-07 22:47:27 on dist-test-slave-tm1g"
server_key: "367fe9e642d8e16717f578e3b1eba4fc"
server_key_iv: "90d2c948258a93b26eb7fd5102451421"
server_key_version: "encryptionkey@0"
I20260807 22:47:27.841871 13524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "283569c98ff04f33beedd791aab4a118"
format_stamp: "Formatted at 2026-08-07 22:47:27 on dist-test-slave-tm1g"
server_key: "367fe9e642d8e16717f578e3b1eba4fc"
server_key_iv: "90d2c948258a93b26eb7fd5102451421"
server_key_version: "encryptionkey@0"
I20260807 22:47:27.845577 13524 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:47:27.848155 13540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:27.849514 13524 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:27.849673 13524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "283569c98ff04f33beedd791aab4a118"
format_stamp: "Formatted at 2026-08-07 22:47:27 on dist-test-slave-tm1g"
server_key: "367fe9e642d8e16717f578e3b1eba4fc"
server_key_iv: "90d2c948258a93b26eb7fd5102451421"
server_key_version: "encryptionkey@0"
I20260807 22:47:27.849789 13524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:27.864760 13524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:27.868113 13524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:27.868345 13524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:27.868955 13524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:27.869817 13524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:27.869891 13524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:27.869964 13524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:27.870010 13524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:27.879984 13524 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:37583
I20260807 22:47:27.880007 13655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:37583 every 8 connection(s)
I20260807 22:47:27.880903 13524 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:27.882105 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 13524
I20260807 22:47:27.882196 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:27.882526 12739 external_mini_cluster.cc:1428] Setting key 1c55c3cc68f2cb4d3ddf52c99bc18ed6
Aug 07 22:47:27 dist-test-slave-tm1g krb5kdc[13277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142847, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:47:27.896404 13362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:27.882808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:55399 (local address 127.12.112.254:36521)
0807 22:47:27.882972 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:27.882978 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:27.884237 (+ 1259us) server_negotiation.cc:407] Connection header received
0807 22:47:27.885571 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:27.885573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:27.885615 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:27.885678 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:27.887093 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:27.887977 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:27.889310 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:27.889750 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:27.889886 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:27.892690 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:27.892696 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:27.892701 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:27.892730 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:27.894365 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:27.894848 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:27.894850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:27.894852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:27.894934 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:27.895277 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:27.895280 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:27.895281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:27.895479 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:27.895557 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:27.896162 (+ 605us) server_negotiation.cc:299] Negotiation successful
0807 22:47:27.896271 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:47:27.897661 13659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:27.883213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36521 (local address 127.12.112.194:55399)
0807 22:47:27.884055 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:27.884131 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:27.885341 (+ 1210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:27.885897 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:27.885908 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:27.886456 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:27.886942 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:27.886955 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:27.888133 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:27.888136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:27.889178 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:27.889188 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:27.889929 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:27.889937 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:27.890086 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:27.890777 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:27.890794 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:27.892508 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:27.894494 (+ 1986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:27.894498 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:27.894510 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:27.894762 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:27.895013 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:27.895015 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:27.895016 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:27.895207 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:27.895572 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:27.895577 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:27.895897 (+ 320us) client_negotiation.cc:769] Sending connection context
0807 22:47:27.896074 (+ 177us) client_negotiation.cc:240] Negotiation successful
0807 22:47:27.896497 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":148,"threads_started":1}
I20260807 22:47:27.898958 13657 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36521
I20260807 22:47:27.899235 13657 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:27.899720 13657 heartbeater.cc:511] Master 127.12.112.254:36521 requested a full tablet report, sending...
I20260807 22:47:27.900843 13323 ts_manager.cc:194] Registered new tserver with Master: 283569c98ff04f33beedd791aab4a118 (127.12.112.194:37583)
I20260807 22:47:27.901727 13323 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:55399
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:47:27.913620 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36521
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:28.026237 13662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:28.026592 13662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:28.026678 13662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:28.030750 13662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:28.030844 13662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:28.030941 13662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:28.036196 13662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36521
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:28.037287 13662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:28.038403 13662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:28.048264 13668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:28.048272 13667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:28.048286 13670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:28.048558 13662 server_base.cc:1034] running on GCE node
I20260807 22:47:28.049073 13662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:28.049710 13662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:28.050899 13662 hybrid_clock.cc:648] HybridClock initialized: now 1786142848050879 us; error 29 us; skew 500 ppm
Aug 07 22:47:28 dist-test-slave-tm1g krb5kdc[13277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142848, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:28.053758 13662 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:47:28.054764 13662 webserver.cc:460] Webserver started at http://127.12.112.195:40815/ using document root <none> and password file <none>
I20260807 22:47:28.055339 13662 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:28.055433 13662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:28.055670 13662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:28.057713 13662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "b88ba72a556a4d4e9c56a71073ed8bfe"
format_stamp: "Formatted at 2026-08-07 22:47:28 on dist-test-slave-tm1g"
server_key: "4f23abd2655ca5577ca60e7ceb57dbea"
server_key_iv: "7f3e767604df6628231d44f383b76604"
server_key_version: "encryptionkey@0"
I20260807 22:47:28.058349 13662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "b88ba72a556a4d4e9c56a71073ed8bfe"
format_stamp: "Formatted at 2026-08-07 22:47:28 on dist-test-slave-tm1g"
server_key: "4f23abd2655ca5577ca60e7ceb57dbea"
server_key_iv: "7f3e767604df6628231d44f383b76604"
server_key_version: "encryptionkey@0"
I20260807 22:47:28.062049 13662 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:47:28.064507 13677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:28.065678 13662 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:47:28.065816 13662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "b88ba72a556a4d4e9c56a71073ed8bfe"
format_stamp: "Formatted at 2026-08-07 22:47:28 on dist-test-slave-tm1g"
server_key: "4f23abd2655ca5577ca60e7ceb57dbea"
server_key_iv: "7f3e767604df6628231d44f383b76604"
server_key_version: "encryptionkey@0"
I20260807 22:47:28.065927 13662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:28.084878 13662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:28.088040 13662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:28.088264 13662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:28.088900 13662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:28.089780 13662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:28.089855 13662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:28.089927 13662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:28.089972 13662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:28.099587 13662 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:44761
I20260807 22:47:28.099614 13793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:44761 every 8 connection(s)
I20260807 22:47:28.100529 13662 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:47:28 dist-test-slave-tm1g krb5kdc[13277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142848, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:28.110239 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 13662
I20260807 22:47:28.110404 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:47:28.110740 12739 external_mini_cluster.cc:1428] Setting key 650981f84f768f7d568c2456c17df1c0
I20260807 22:47:28.114938 13362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.102442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:56781 (local address 127.12.112.254:36521)
0807 22:47:28.102590 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:28.102594 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:28.103682 (+ 1088us) server_negotiation.cc:407] Connection header received
0807 22:47:28.104599 (+ 917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:28.104603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:28.104661 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:28.104765 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:28.106126 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.106758 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.107924 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.108156 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.108267 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.110969 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:28.110972 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:28.110974 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:28.110998 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:28.112739 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:28.113342 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:28.113346 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:28.113348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:28.113446 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:28.113796 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:28.113800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:28.113802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:28.113995 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:28.114105 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:28.114655 (+ 550us) server_negotiation.cc:299] Negotiation successful
0807 22:47:28.114777 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:47:28.115795 13796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.102833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36521 (local address 127.12.112.195:56781)
0807 22:47:28.103520 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:28.103563 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:28.104384 (+ 821us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:28.104935 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:28.104942 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:28.105310 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:28.105878 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.105891 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.106894 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.106897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.107783 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.107792 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.108312 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.108317 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.108500 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.109124 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:28.109140 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:28.110742 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:28.112865 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:28.112873 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:28.112890 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:28.113235 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:28.113543 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:28.113546 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:28.113548 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:28.113695 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:28.114104 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:28.114111 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:28.114418 (+ 307us) client_negotiation.cc:769] Sending connection context
0807 22:47:28.114613 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 22:47:28.114943 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":118,"threads_started":1}
I20260807 22:47:28.116904 13794 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36521
I20260807 22:47:28.117141 13794 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:28.117626 13794 heartbeater.cc:511] Master 127.12.112.254:36521 requested a full tablet report, sending...
I20260807 22:47:28.118752 13323 ts_manager.cc:194] Registered new tserver with Master: b88ba72a556a4d4e9c56a71073ed8bfe (127.12.112.195:44761)
I20260807 22:47:28.119320 13323 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:56781
I20260807 22:47:28.124907 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:47:28.135773 13362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.128679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39128 (local address 127.12.112.254:36521)
0807 22:47:28.128816 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:28.128819 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:28.128905 (+ 86us) server_negotiation.cc:407] Connection header received
0807 22:47:28.129003 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:28.129006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:28.129047 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:28.129118 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:28.129815 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.130399 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.131172 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.131378 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.131451 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.132750 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:28.132753 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:28.132755 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:28.132778 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:28.134209 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:28.134669 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:28.134671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:28.134672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:28.134748 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:28.134978 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:28.134980 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:28.134981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:28.135186 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:28.135289 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:28.135559 (+ 270us) server_negotiation.cc:299] Negotiation successful
0807 22:47:28.135653 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:47:28.140516 13323 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:47:28.143720 13323 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:28.158862 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.152505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44456 (local address 127.12.112.195:44761)
0807 22:47:28.153301 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:28.153314 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:28.153339 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:47:28.153420 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:28.153425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:28.153629 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:28.154219 (+ 590us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:28.154406 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.155638 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.157388 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.158137 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.158368 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.158483 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:28.158592 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 22:47:28.158692 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":152,"threads_started":1}
I20260807 22:47:28.158906 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.152347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44761 (local address 127.0.0.1:44456)
0807 22:47:28.152729 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:28.152792 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:28.152922 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:28.153836 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:28.153842 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:28.153869 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:28.154030 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.154039 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.155834 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.155837 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.157261 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.157272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.158268 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.158284 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.158409 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.158456 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 22:47:28.158561 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 22:47:28.158739 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":130,"thread_start_us":91,"threads_started":1}
I20260807 22:47:28.159241 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.153137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:43731 (local address 127.0.0.1:51976)
0807 22:47:28.153727 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:28.153741 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:28.153828 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:28.154484 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:28.154487 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:28.154505 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:28.154598 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.154606 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.155999 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.156005 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.157091 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.157101 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.158364 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.158367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.158454 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.158477 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:47:28.158564 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 22:47:28.158703 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":5,"thread_start_us":99,"threads_started":1}
I20260807 22:47:28.159422 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.153587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51976 (local address 127.12.112.193:43731)
0807 22:47:28.153968 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:28.153983 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:28.154024 (+ 41us) server_negotiation.cc:407] Connection header received
0807 22:47:28.154101 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:28.154109 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:28.154332 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:28.154491 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:28.154722 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.155824 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.157214 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.158070 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.158214 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.158852 (+ 638us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:28.158907 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 22:47:28.159013 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":82,"threads_started":1}
I20260807 22:47:28.159739 13808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.152606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55896 (local address 127.12.112.194:37583)
0807 22:47:28.153451 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:28.153466 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:28.153492 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:47:28.154045 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:28.154052 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:28.154254 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:28.154409 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:28.154852 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.155591 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.157507 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.158064 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.158208 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.158370 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:28.159111 (+ 741us) server_negotiation.cc:299] Negotiation successful
0807 22:47:28.159217 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":116,"threads_started":1}
I20260807 22:47:28.158906 13809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.152352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:37583 (local address 127.0.0.1:55896)
0807 22:47:28.153190 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:28.153206 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:28.153850 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:28.154632 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:28.154638 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:28.154658 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:28.154739 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.154743 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.155723 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.155728 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.157398 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.157405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.158196 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.158200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.158665 (+ 465us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.158686 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:47:28.158745 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 22:47:28.158803 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":776,"mutex_wait_us":768,"thread_start_us":100,"threads_started":1}
I20260807 22:47:28.162186 13725 tablet_service.cc:1467] Processing CreateTablet for tablet 0a41f46222904967b59307e807334678 (DEFAULT_TABLE table=test-table [id=f218a00ba81f49948ea04a8217d97fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:28.162382 13451 tablet_service.cc:1467] Processing CreateTablet for tablet 0a41f46222904967b59307e807334678 (DEFAULT_TABLE table=test-table [id=f218a00ba81f49948ea04a8217d97fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:28.163381 13451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a41f46222904967b59307e807334678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:28.163383 13725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a41f46222904967b59307e807334678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:28.164637 13589 tablet_service.cc:1467] Processing CreateTablet for tablet 0a41f46222904967b59307e807334678 (DEFAULT_TABLE table=test-table [id=f218a00ba81f49948ea04a8217d97fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:28.165665 13589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a41f46222904967b59307e807334678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:28.170029 13812 tablet_bootstrap.cc:492] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe: Bootstrap starting.
I20260807 22:47:28.170931 13813 tablet_bootstrap.cc:492] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf: Bootstrap starting.
I20260807 22:47:28.172601 13812 tablet_bootstrap.cc:654] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:28.173117 13813 tablet_bootstrap.cc:654] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:28.173152 13814 tablet_bootstrap.cc:492] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118: Bootstrap starting.
I20260807 22:47:28.174371 13813 log.cc:824] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:28.174377 13812 log.cc:824] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:28.175807 13814 tablet_bootstrap.cc:654] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:28.176393 13813 tablet_bootstrap.cc:492] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf: No bootstrap required, opened a new log
I20260807 22:47:28.176592 13813 ts_tablet_manager.cc:1397] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:47:28.176669 13814 log.cc:824] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:28.178480 13812 tablet_bootstrap.cc:492] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe: No bootstrap required, opened a new log
I20260807 22:47:28.178682 13812 ts_tablet_manager.cc:1397] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 22:47:28.179877 13814 tablet_bootstrap.cc:492] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118: No bootstrap required, opened a new log
I20260807 22:47:28.180051 13814 ts_tablet_manager.cc:1397] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 22:47:28.180089 13813 raft_consensus.cc:348] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44761 } } peers { permanent_uuid: "283569c98ff04f33beedd791aab4a118" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 37583 } } peers { permanent_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 43731 } }
I20260807 22:47:28.180375 13813 raft_consensus.cc:374] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:28.180436 13813 raft_consensus.cc:729] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd250fb9f03548908b3b3a8a4eb1e5bf, State: Initialized, Role: FOLLOWER
I20260807 22:47:28.180945 13813 consensus_queue.cc:260] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44761 } } peers { permanent_uuid: "283569c98ff04f33beedd791aab4a118" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 37583 } } peers { permanent_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 43731 } }
I20260807 22:47:28.181944 13813 ts_tablet_manager.cc:1428] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 22:47:28.182051 13812 raft_consensus.cc:348] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44761 } } peers { permanent_uuid: "283569c98ff04f33beedd791aab4a118" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 37583 } } peers { permanent_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 43731 } }
I20260807 22:47:28.182341 13812 raft_consensus.cc:374] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:28.182367 13519 heartbeater.cc:503] Master 127.12.112.254:36521 was elected leader, sending a full tablet report...
I20260807 22:47:28.182412 13812 raft_consensus.cc:729] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88ba72a556a4d4e9c56a71073ed8bfe, State: Initialized, Role: FOLLOWER
I20260807 22:47:28.182817 13812 consensus_queue.cc:260] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44761 } } peers { permanent_uuid: "283569c98ff04f33beedd791aab4a118" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 37583 } } peers { permanent_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 43731 } }
I20260807 22:47:28.183461 13794 heartbeater.cc:503] Master 127.12.112.254:36521 was elected leader, sending a full tablet report...
I20260807 22:47:28.183779 13812 ts_tablet_manager.cc:1428] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:47:28.184207 13814 raft_consensus.cc:348] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44761 } } peers { permanent_uuid: "283569c98ff04f33beedd791aab4a118" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 37583 } } peers { permanent_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 43731 } }
I20260807 22:47:28.184490 13814 raft_consensus.cc:374] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:28.184544 13814 raft_consensus.cc:729] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283569c98ff04f33beedd791aab4a118, State: Initialized, Role: FOLLOWER
I20260807 22:47:28.184928 13814 consensus_queue.cc:260] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44761 } } peers { permanent_uuid: "283569c98ff04f33beedd791aab4a118" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 37583 } } peers { permanent_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 43731 } }
I20260807 22:47:28.185796 13814 ts_tablet_manager.cc:1428] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:47:28.185914 13657 heartbeater.cc:503] Master 127.12.112.254:36521 was elected leader, sending a full tablet report...
W20260807 22:47:28.351534 13795 tablet.cc:2369] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:47:28.382107 13658 tablet.cc:2369] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:47:28.411968 13520 tablet.cc:2369] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:47:28.492117 13820 raft_consensus.cc:482] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:28.492370 13820 raft_consensus.cc:504] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44761 } } peers { permanent_uuid: "283569c98ff04f33beedd791aab4a118" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 37583 } } peers { permanent_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 43731 } }
I20260807 22:47:28.493563 13820 leader_election.cc:288] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b88ba72a556a4d4e9c56a71073ed8bfe (127.12.112.195:44761), bd250fb9f03548908b3b3a8a4eb1e5bf (127.12.112.193:43731)
I20260807 22:47:28.497756 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.493980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:35433 (local address 127.12.112.195:44761)
0807 22:47:28.494132 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:28.494138 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:28.494502 (+ 364us) server_negotiation.cc:407] Connection header received
0807 22:47:28.494669 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:28.494673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:28.494723 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:28.494811 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:28.495141 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.495650 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.496759 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.497179 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.497313 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.497368 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:28.497551 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 22:47:28.497618 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:47:28.497792 13821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.493886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:43731 (local address 127.12.112.194:49423)
0807 22:47:28.494269 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:28.494347 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:28.494458 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:28.494747 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:28.494750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:28.494767 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:28.494912 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.494919 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.495696 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.495701 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.496625 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.496635 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.497324 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.497327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.497448 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.497465 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 22:47:28.497556 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 22:47:28.497629 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":50,"thread_start_us":108,"threads_started":1}
I20260807 22:47:28.497774 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.494020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:49423 (local address 127.12.112.193:43731)
0807 22:47:28.494138 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:28.494144 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:28.494439 (+ 295us) server_negotiation.cc:407] Connection header received
0807 22:47:28.494602 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:28.494605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:28.494651 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:28.494739 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:28.495048 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.495584 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.496758 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.497191 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.497324 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.497381 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:28.497574 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 22:47:28.497645 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:47:28.497812 13822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.493891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44761 (local address 127.12.112.194:35433)
0807 22:47:28.494412 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:28.494429 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:28.494545 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:28.494834 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:28.494837 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:28.494853 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:28.495020 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.495026 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.495767 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.495772 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.496633 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:28.496642 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.497313 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.497317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:28.497415 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.497438 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:47:28.497536 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 22:47:28.497611 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":85,"thread_start_us":79,"threads_started":1}
I20260807 22:47:28.498534 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a41f46222904967b59307e807334678" candidate_uuid: "283569c98ff04f33beedd791aab4a118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" is_pre_election: true
I20260807 22:47:28.498658 13747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a41f46222904967b59307e807334678" candidate_uuid: "283569c98ff04f33beedd791aab4a118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" is_pre_election: true
I20260807 22:47:28.498890 13747 raft_consensus.cc:2454] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 283569c98ff04f33beedd791aab4a118 in term 0.
I20260807 22:47:28.498891 13473 raft_consensus.cc:2454] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 283569c98ff04f33beedd791aab4a118 in term 0.
I20260807 22:47:28.499428 13541 leader_election.cc:302] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 283569c98ff04f33beedd791aab4a118, b88ba72a556a4d4e9c56a71073ed8bfe, bd250fb9f03548908b3b3a8a4eb1e5bf; no voters:
I20260807 22:47:28.499706 13820 raft_consensus.cc:2781] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:28.499805 13820 raft_consensus.cc:482] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:28.499871 13820 raft_consensus.cc:3037] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:28.500981 13820 raft_consensus.cc:504] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44761 } } peers { permanent_uuid: "283569c98ff04f33beedd791aab4a118" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 37583 } } peers { permanent_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 43731 } }
I20260807 22:47:28.501359 13820 leader_election.cc:288] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [CANDIDATE]: Term 1 election: Requested vote from peers b88ba72a556a4d4e9c56a71073ed8bfe (127.12.112.195:44761), bd250fb9f03548908b3b3a8a4eb1e5bf (127.12.112.193:43731)
I20260807 22:47:28.501772 13747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a41f46222904967b59307e807334678" candidate_uuid: "283569c98ff04f33beedd791aab4a118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe"
I20260807 22:47:28.501839 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a41f46222904967b59307e807334678" candidate_uuid: "283569c98ff04f33beedd791aab4a118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf"
I20260807 22:47:28.501889 13747 raft_consensus.cc:3037] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:28.502018 13473 raft_consensus.cc:3037] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:28.503110 13747 raft_consensus.cc:2454] T 0a41f46222904967b59307e807334678 P b88ba72a556a4d4e9c56a71073ed8bfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 283569c98ff04f33beedd791aab4a118 in term 1.
I20260807 22:47:28.503347 13473 raft_consensus.cc:2454] T 0a41f46222904967b59307e807334678 P bd250fb9f03548908b3b3a8a4eb1e5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 283569c98ff04f33beedd791aab4a118 in term 1.
I20260807 22:47:28.503494 13541 leader_election.cc:302] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 283569c98ff04f33beedd791aab4a118, b88ba72a556a4d4e9c56a71073ed8bfe; no voters:
I20260807 22:47:28.503696 13820 raft_consensus.cc:2781] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:28.503909 13820 raft_consensus.cc:686] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [term 1 LEADER]: Becoming Leader. State: Replica: 283569c98ff04f33beedd791aab4a118, State: Running, Role: LEADER
I20260807 22:47:28.504256 13820 consensus_queue.cc:237] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44761 } } peers { permanent_uuid: "283569c98ff04f33beedd791aab4a118" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 37583 } } peers { permanent_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 43731 } }
I20260807 22:47:28.507500 13321 catalog_manager.cc:5495] T 0a41f46222904967b59307e807334678 P 283569c98ff04f33beedd791aab4a118 reported cstate change: term changed from 0 to 1, leader changed from <none> to 283569c98ff04f33beedd791aab4a118 (127.12.112.194). New cstate: current_term: 1 leader_uuid: "283569c98ff04f33beedd791aab4a118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88ba72a556a4d4e9c56a71073ed8bfe" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "283569c98ff04f33beedd791aab4a118" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 37583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd250fb9f03548908b3b3a8a4eb1e5bf" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 43731 } health_report { overall_health: UNKNOWN } } }
Aug 07 22:47:28 dist-test-slave-tm1g krb5kdc[13277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:47:28.522910 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.514086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49116 (local address 127.12.112.193:43731)
0807 22:47:28.514240 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:28.514245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:28.514443 (+ 198us) server_negotiation.cc:407] Connection header received
0807 22:47:28.514563 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:28.514566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:28.514609 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:28.514684 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:28.515329 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.515829 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.516628 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.516828 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.516909 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.519378 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:28.519389 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:28.519402 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:28.519425 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:28.521012 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:28.521433 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:28.521439 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:28.521440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:28.521526 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:28.521771 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:28.521774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:28.521775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:28.522003 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:28.522164 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:28.522637 (+ 473us) server_negotiation.cc:299] Negotiation successful
0807 22:47:28.522792 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 22:47:28 dist-test-slave-tm1g krb5kdc[13277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142848, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:47:28 dist-test-slave-tm1g krb5kdc[13277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142848, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:47:28.550985 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.542386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49120 (local address 127.12.112.193:43731)
0807 22:47:28.542526 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:28.542532 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:28.542708 (+ 176us) server_negotiation.cc:407] Connection header received
0807 22:47:28.542899 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:28.542902 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:28.542944 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:28.543028 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:28.543716 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.544248 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.545079 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.545325 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.545436 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.547923 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:28.547926 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:28.547927 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:28.547951 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:28.549268 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:28.549700 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:28.549710 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:28.549712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:28.549786 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:28.550068 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:28.550072 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:28.550074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:28.550240 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:28.550399 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:28.550682 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 22:47:28.550808 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 22:47:28 dist-test-slave-tm1g krb5kdc[13277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:47:28 dist-test-slave-tm1g krb5kdc[13277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:47:28.576856 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:28.568435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49136 (local address 127.12.112.193:43731)
0807 22:47:28.568591 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:28.568595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:28.568643 (+ 48us) server_negotiation.cc:407] Connection header received
0807 22:47:28.568745 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:28.568748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:28.568792 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:28.568881 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:28.569525 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.570081 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.571014 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:28.571233 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:28.571352 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:28.573645 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:28.573648 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:28.573650 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:28.573672 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:28.575259 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:28.575636 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:28.575639 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:28.575640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:28.575713 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:28.576005 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:28.576008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:28.576009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:28.576212 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:28.576345 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:28.576546 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 22:47:28.576640 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 22:47:28.578512 13431 tablet_service.cc:2908] Rejecting scan request for tablet 0a41f46222904967b59307e807334678: Uninitialized: clean time has not yet been initialized
I20260807 22:47:28.580667 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 13387
I20260807 22:47:28.588632 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 13524
I20260807 22:47:28.594610 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 13662
I20260807 22:47:28.601193 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 13290
2026-08-07T22:47:28Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2626 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:28 dist-test-slave-tm1g krb5kdc[13837](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:28 dist-test-slave-tm1g krb5kdc[13837](info): set up 2 sockets
Aug 07 22:47:28 dist-test-slave-tm1g krb5kdc[13837](info): commencing operation
krb5kdc: starting...
W20260807 22:47:29.674099 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:29 dist-test-slave-tm1g krb5kdc[13837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:47:29.797026 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33529
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:33529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:29.906553 13850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:29.906788 13850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:29.906826 13850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:29.910717 13850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:29.910763 13850 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 22:47:29.910779 13850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:29.910797 13850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:29.910813 13850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:29.910828 13850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:29.915982 13850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:33529
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:29.916893 13850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:29.917827 13850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:29.926458 13855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:29.926450 13859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:29.926467 13857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:29.926793 13850 server_base.cc:1034] running on GCE node
I20260807 22:47:29.927368 13850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:29.928323 13850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:29.929517 13850 hybrid_clock.cc:648] HybridClock initialized: now 1786142849929505 us; error 35 us; skew 500 ppm
Aug 07 22:47:29 dist-test-slave-tm1g krb5kdc[13837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142849, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:29.937310 13850 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:47:29.938181 13850 webserver.cc:460] Webserver started at http://127.12.112.254:40001/ using document root <none> and password file <none>
I20260807 22:47:29.938766 13850 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:29.938827 13850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:29.938989 13850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:29.940907 13850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "6d65200fbfc642c798ef2b5eb0504863"
format_stamp: "Formatted at 2026-08-07 22:47:29 on dist-test-slave-tm1g"
server_key: "dc5862ba80a1505840e0acb7c00d0123"
server_key_iv: "b5f124af8a8740d37ec3bee2c6bd78e2"
server_key_version: "encryptionkey@0"
I20260807 22:47:29.941414 13850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "6d65200fbfc642c798ef2b5eb0504863"
format_stamp: "Formatted at 2026-08-07 22:47:29 on dist-test-slave-tm1g"
server_key: "dc5862ba80a1505840e0acb7c00d0123"
server_key_iv: "b5f124af8a8740d37ec3bee2c6bd78e2"
server_key_version: "encryptionkey@0"
I20260807 22:47:29.944918 13850 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 22:47:29.947337 13866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:29.948485 13850 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:29.948606 13850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "6d65200fbfc642c798ef2b5eb0504863"
format_stamp: "Formatted at 2026-08-07 22:47:29 on dist-test-slave-tm1g"
server_key: "dc5862ba80a1505840e0acb7c00d0123"
server_key_iv: "b5f124af8a8740d37ec3bee2c6bd78e2"
server_key_version: "encryptionkey@0"
I20260807 22:47:29.948704 13850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:29.959638 13850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:29.962754 13850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:29.962954 13850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:29.970917 13850 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:33529
I20260807 22:47:29.970934 13931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:33529 every 8 connection(s)
I20260807 22:47:29.971851 13850 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:29.973093 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 13850
I20260807 22:47:29.973213 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:29.973496 12739 external_mini_cluster.cc:1428] Setting key f6724890aa8b7a726aca869dea272b09
I20260807 22:47:29.975092 13932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:29.981701 13932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863: Bootstrap starting.
Aug 07 22:47:29 dist-test-slave-tm1g krb5kdc[13837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:29.984236 13932 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:29.984972 13932 log.cc:824] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:29.987031 13932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863: No bootstrap required, opened a new log
I20260807 22:47:29.988858 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:29.974947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34818 (local address 127.12.112.254:33529)
0807 22:47:29.975387 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:29.975406 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:29.975448 (+ 42us) server_negotiation.cc:407] Connection header received
0807 22:47:29.976248 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:29.976269 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:29.976674 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:29.977009 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:29.977651 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:29.979175 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:29.980036 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:29.980733 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:29.980911 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:29.983335 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:29.983341 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:29.983355 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:29.983385 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:29.986036 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:29.986559 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:29.986564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:29.986568 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:29.986678 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:29.986973 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:29.986976 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:29.986978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:29.987401 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:29.987607 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:29.987890 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 22:47:29.988153 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":120,"threads_started":1}
I20260807 22:47:29.990255 13932 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d65200fbfc642c798ef2b5eb0504863" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33529 } }
I20260807 22:47:29.990540 13932 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:29.990592 13932 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65200fbfc642c798ef2b5eb0504863, State: Initialized, Role: FOLLOWER
I20260807 22:47:29.991035 13932 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d65200fbfc642c798ef2b5eb0504863" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33529 } }
I20260807 22:47:29.991201 13932 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:29.991254 13932 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:29.991328 13932 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:29.992144 13932 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d65200fbfc642c798ef2b5eb0504863" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33529 } }
I20260807 22:47:29.992420 13932 leader_election.cc:302] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d65200fbfc642c798ef2b5eb0504863; no voters:
I20260807 22:47:29.992671 13932 leader_election.cc:288] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:29.992805 13937 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:29.993049 13937 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [term 1 LEADER]: Becoming Leader. State: Replica: 6d65200fbfc642c798ef2b5eb0504863, State: Running, Role: LEADER
I20260807 22:47:29.993386 13937 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d65200fbfc642c798ef2b5eb0504863" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33529 } }
I20260807 22:47:29.993870 13932 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:29.995107 13939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d65200fbfc642c798ef2b5eb0504863. Latest consensus state: current_term: 1 leader_uuid: "6d65200fbfc642c798ef2b5eb0504863" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d65200fbfc642c798ef2b5eb0504863" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33529 } } }
I20260807 22:47:29.995131 13938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d65200fbfc642c798ef2b5eb0504863" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d65200fbfc642c798ef2b5eb0504863" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33529 } } }
I20260807 22:47:29.995275 13938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:29.995275 13939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:29.995694 13947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:29.998821 13947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:30.003676 13947 catalog_manager.cc:1347] Generated new cluster ID: 08be86fc8ce8406ca05f49451932e043
I20260807 22:47:30.003741 13947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:30.010663 13947 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:30.011979 13947 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:30.022855 13947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863: Generated new TSK 0
I20260807 22:47:30.023584 13947 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:47:30.061833 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33529
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:30.172096 13960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:30.172334 13960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:30.172377 13960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:30.176213 13960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:30.176258 13960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:30.176295 13960 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:47:30.176326 13960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:30.181348 13960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.112.254:33529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:30.182262 13960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:30.183266 13960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:30.192682 13966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:30.192675 13968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:30.192749 13960 server_base.cc:1034] running on GCE node
W20260807 22:47:30.192670 13965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:30.193238 13960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:30.193956 13960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:30.195134 13960 hybrid_clock.cc:648] HybridClock initialized: now 1786142850195121 us; error 24 us; skew 500 ppm
Aug 07 22:47:30 dist-test-slave-tm1g krb5kdc[13837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142850, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:30.197978 13960 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:47:30.198846 13960 webserver.cc:460] Webserver started at http://127.12.112.193:36323/ using document root <none> and password file <none>
I20260807 22:47:30.199407 13960 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:30.199501 13960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:30.199728 13960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:30.201683 13960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "a7b2fe88d8a54e0a99ddb969eef84d64"
format_stamp: "Formatted at 2026-08-07 22:47:30 on dist-test-slave-tm1g"
server_key: "a481173aff19fada994b734a1938196c"
server_key_iv: "811c77ac73ccbd371119a1432aceab4f"
server_key_version: "encryptionkey@0"
I20260807 22:47:30.202232 13960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "a7b2fe88d8a54e0a99ddb969eef84d64"
format_stamp: "Formatted at 2026-08-07 22:47:30 on dist-test-slave-tm1g"
server_key: "a481173aff19fada994b734a1938196c"
server_key_iv: "811c77ac73ccbd371119a1432aceab4f"
server_key_version: "encryptionkey@0"
I20260807 22:47:30.205736 13960 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:47:30.208065 13975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:30.209215 13960 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:30.209357 13960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "a7b2fe88d8a54e0a99ddb969eef84d64"
format_stamp: "Formatted at 2026-08-07 22:47:30 on dist-test-slave-tm1g"
server_key: "a481173aff19fada994b734a1938196c"
server_key_iv: "811c77ac73ccbd371119a1432aceab4f"
server_key_version: "encryptionkey@0"
I20260807 22:47:30.209466 13960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:30.221024 13960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:30.223918 13960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:30.224109 13960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:30.225488 13960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:30.225562 13960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:30.225628 13960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:30.225682 13960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:47:30 dist-test-slave-tm1g krb5kdc[13837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142850, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:30.237083 13960 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:33879
I20260807 22:47:30.237134 14094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:33879 every 8 connection(s)
I20260807 22:47:30.238267 13960 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:30.239883 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.226378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:33259 (local address 127.12.112.254:33529)
0807 22:47:30.226517 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.226521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.227466 (+ 945us) server_negotiation.cc:407] Connection header received
0807 22:47:30.228414 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.228420 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.228486 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.228585 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:30.230150 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.231115 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.232595 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.232848 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.232965 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.235952 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:30.235956 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:30.235961 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:30.235990 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:30.237694 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.238225 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.238232 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.238237 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.238369 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.238757 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.238760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.238762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.239014 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:30.239122 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.239645 (+ 523us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.239759 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:47:30.240587 13984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.226852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33529 (local address 127.12.112.193:33259)
0807 22:47:30.227308 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.227353 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.228167 (+ 814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.228895 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.228906 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.229401 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:30.229973 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.229990 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.231271 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.231275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.232461 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.232471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.233011 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.233016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.233239 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.233882 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:30.233902 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:30.235789 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:30.237830 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.237835 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.237845 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.238116 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.238457 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.238460 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.238462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.238605 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.239127 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:30.239132 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:30.239421 (+ 289us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.239576 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.239804 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":125,"threads_started":1}
I20260807 22:47:30.242118 14095 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33529
I20260807 22:47:30.242259 14095 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:30.242841 14095 heartbeater.cc:511] Master 127.12.112.254:33529 requested a full tablet report, sending...
I20260807 22:47:30.244513 13885 ts_manager.cc:194] Registered new tserver with Master: a7b2fe88d8a54e0a99ddb969eef84d64 (127.12.112.193:33879)
I20260807 22:47:30.245883 13885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:33259
I20260807 22:47:30.248252 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 13960
I20260807 22:47:30.248404 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:30.248677 12739 external_mini_cluster.cc:1428] Setting key 8eab3d10d533d0f0b361596033123346
I20260807 22:47:30.251838 14101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.244387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33529 (local address 127.12.112.193:38733)
0807 22:47:30.244663 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.244678 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.244778 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.245010 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.245013 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.245214 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:30.245347 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.245354 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.246075 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.246078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.246883 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.246893 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.247332 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.247336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.247421 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.247883 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:30.247898 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:30.248342 (+ 444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:30.250219 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.250224 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.250228 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.250513 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.250798 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.250800 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.250801 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.250880 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.251327 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:30.251330 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:30.251413 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.251493 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.251637 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":106,"threads_started":1}
I20260807 22:47:30.251996 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.244448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:38733 (local address 127.12.112.254:33529)
0807 22:47:30.244578 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.244582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.244750 (+ 168us) server_negotiation.cc:407] Connection header received
0807 22:47:30.244863 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.244865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.244904 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.244967 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:30.245456 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.245948 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.247011 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.247221 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.247297 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.248511 (+ 1214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:30.248516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:30.248519 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:30.248542 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:30.250068 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.250610 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.250614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.250616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.250703 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.250980 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.250986 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.250990 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.251228 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:30.251335 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.251622 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.251756 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:47:30.276741 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33529
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:30.389436 14104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:30.389685 14104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:30.389763 14104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:30.393837 14104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:30.393904 14104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:30.393945 14104 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:47:30.394034 14104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:30.399576 14104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.112.254:33529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:30.400619 14104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:30.401630 14104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:30.411363 14112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:30.411379 14109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:30.411441 14104 server_base.cc:1034] running on GCE node
W20260807 22:47:30.411379 14110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:30.412050 14104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:30.412767 14104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:30.413925 14104 hybrid_clock.cc:648] HybridClock initialized: now 1786142850413893 us; error 43 us; skew 500 ppm
Aug 07 22:47:30 dist-test-slave-tm1g krb5kdc[13837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142850, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:30.416730 14104 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:47:30.417565 14104 webserver.cc:460] Webserver started at http://127.12.112.194:35337/ using document root <none> and password file <none>
I20260807 22:47:30.418089 14104 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:30.418147 14104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:30.418391 14104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:30.420428 14104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "d72d8457626b46d2b179891a006bebda"
format_stamp: "Formatted at 2026-08-07 22:47:30 on dist-test-slave-tm1g"
server_key: "026d03407c7b9c254a3db84df7e6c7dc"
server_key_iv: "43f1bb0920bb63841e170bbcd234b8cb"
server_key_version: "encryptionkey@0"
I20260807 22:47:30.420957 14104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "d72d8457626b46d2b179891a006bebda"
format_stamp: "Formatted at 2026-08-07 22:47:30 on dist-test-slave-tm1g"
server_key: "026d03407c7b9c254a3db84df7e6c7dc"
server_key_iv: "43f1bb0920bb63841e170bbcd234b8cb"
server_key_version: "encryptionkey@0"
I20260807 22:47:30.424783 14104 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260807 22:47:30.427502 14119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:30.428766 14104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:47:30.429013 14104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "d72d8457626b46d2b179891a006bebda"
format_stamp: "Formatted at 2026-08-07 22:47:30 on dist-test-slave-tm1g"
server_key: "026d03407c7b9c254a3db84df7e6c7dc"
server_key_iv: "43f1bb0920bb63841e170bbcd234b8cb"
server_key_version: "encryptionkey@0"
I20260807 22:47:30.429136 14104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:30.440030 14104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:30.443536 14104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:30.443691 14104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:30.445037 14104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:30.445086 14104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:30.445153 14104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:30.445197 14104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:30.455261 14104 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:36021
I20260807 22:47:30.455368 14237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:36021 every 8 connection(s)
Aug 07 22:47:30 dist-test-slave-tm1g krb5kdc[13837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142850, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:30.456204 14104 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:30.460036 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.445998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:43099 (local address 127.12.112.254:33529)
0807 22:47:30.446129 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.446134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.447247 (+ 1113us) server_negotiation.cc:407] Connection header received
0807 22:47:30.448431 (+ 1184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.448438 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.448509 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.448618 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:30.450224 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.451196 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.453003 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.453275 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.453381 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.456368 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:30.456372 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:30.456375 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:30.456409 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:30.457929 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.458497 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.458501 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.458503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.458593 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.458940 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.458943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.458944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.459137 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:30.459243 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.459729 (+ 486us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.459858 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:47:30.460839 14128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.446533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33529 (local address 127.12.112.194:43099)
0807 22:47:30.447103 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.447145 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.448168 (+ 1023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.448841 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.448852 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.449326 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:30.450031 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.450058 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.451358 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.451362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.452846 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.452860 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.453567 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.453573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.453799 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.454515 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:30.454531 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:30.456165 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:30.458060 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.458066 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.458079 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.458389 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.458687 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.458691 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.458693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.458835 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.459242 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:30.459248 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:30.459490 (+ 242us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.459669 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.459989 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":126,"threads_started":1}
I20260807 22:47:30.462190 14238 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33529
I20260807 22:47:30.462404 14238 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:30.462908 14238 heartbeater.cc:511] Master 127.12.112.254:33529 requested a full tablet report, sending...
I20260807 22:47:30.463193 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 14104
I20260807 22:47:30.463326 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:30.463660 12739 external_mini_cluster.cc:1428] Setting key 2847296a5651b60f60179267ddccedf6
I20260807 22:47:30.464097 13885 ts_manager.cc:194] Registered new tserver with Master: d72d8457626b46d2b179891a006bebda (127.12.112.194:36021)
I20260807 22:47:30.464876 13885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:43099
I20260807 22:47:30.472555 14244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.464472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33529 (local address 127.12.112.194:37851)
0807 22:47:30.465057 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.465071 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.465200 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.465462 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.465465 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.465666 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:30.465763 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.465769 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.466585 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.466589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.467174 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.467188 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.467991 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.467997 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.468119 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.468633 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:30.468652 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:30.468986 (+ 334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:30.470916 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.470921 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.470924 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.471154 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.471495 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.471497 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.471499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.471586 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.472147 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:30.472149 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:30.472225 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.472303 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.472421 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":98,"threads_started":1}
I20260807 22:47:30.472914 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.464517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:37851 (local address 127.12.112.254:33529)
0807 22:47:30.464625 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.464631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.465131 (+ 500us) server_negotiation.cc:407] Connection header received
0807 22:47:30.465300 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.465303 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.465345 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.465438 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:30.465873 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.466464 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.467339 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.467734 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.467819 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.469122 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:30.469128 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:30.469134 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:30.469165 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:30.470785 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.471260 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.471263 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.471265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.471354 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.471691 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.471697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.471702 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.472038 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:30.472151 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.472397 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.472537 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:47:30.494316 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33529
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:30.609328 14247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:30.609591 14247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:30.609674 14247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:30.613776 14247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:30.613858 14247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:30.613940 14247 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:47:30.614012 14247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:30.619220 14247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.112.254:33529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:30.620184 14247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:30.621130 14247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:30.630648 14252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:30.630722 14253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:30.630712 14247 server_base.cc:1034] running on GCE node
W20260807 22:47:30.630642 14255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:30.631274 14247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:30.631943 14247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:30.633127 14247 hybrid_clock.cc:648] HybridClock initialized: now 1786142850633112 us; error 38 us; skew 500 ppm
Aug 07 22:47:30 dist-test-slave-tm1g krb5kdc[13837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142850, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:30.635849 14247 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:47:30.636714 14247 webserver.cc:460] Webserver started at http://127.12.112.195:46017/ using document root <none> and password file <none>
I20260807 22:47:30.637283 14247 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:30.637380 14247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:30.637612 14247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:30.639724 14247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "09bcc041cec044a89a01928bef5e267e"
format_stamp: "Formatted at 2026-08-07 22:47:30 on dist-test-slave-tm1g"
server_key: "a0d86b0b2f487b6b67fc52cbe32c6249"
server_key_iv: "eb3c463d82f10f77a1e54184492eabb7"
server_key_version: "encryptionkey@0"
I20260807 22:47:30.640307 14247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "09bcc041cec044a89a01928bef5e267e"
format_stamp: "Formatted at 2026-08-07 22:47:30 on dist-test-slave-tm1g"
server_key: "a0d86b0b2f487b6b67fc52cbe32c6249"
server_key_iv: "eb3c463d82f10f77a1e54184492eabb7"
server_key_version: "encryptionkey@0"
I20260807 22:47:30.644166 14247 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:47:30.646474 14262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:30.647648 14247 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:47:30.647775 14247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "09bcc041cec044a89a01928bef5e267e"
format_stamp: "Formatted at 2026-08-07 22:47:30 on dist-test-slave-tm1g"
server_key: "a0d86b0b2f487b6b67fc52cbe32c6249"
server_key_iv: "eb3c463d82f10f77a1e54184492eabb7"
server_key_version: "encryptionkey@0"
I20260807 22:47:30.647879 14247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:30.684669 14247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:30.687834 14247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:30.688047 14247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:30.689534 14247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:30.689607 14247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:30.689679 14247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:30.689720 14247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:47:30 dist-test-slave-tm1g krb5kdc[13837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142850, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:30.701030 14247 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:44101
I20260807 22:47:30.701093 14386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:44101 every 8 connection(s)
I20260807 22:47:30.701931 14247 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:47:30.704581 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.690509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:49875 (local address 127.12.112.254:33529)
0807 22:47:30.690634 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.690639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.691716 (+ 1077us) server_negotiation.cc:407] Connection header received
0807 22:47:30.692746 (+ 1030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.692749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.692823 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.692896 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:30.694617 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.695481 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.697229 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.697661 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.697802 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.701004 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:30.701008 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:30.701010 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:30.701042 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:30.702692 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.703272 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.703276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.703278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.703374 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.703654 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.703657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.703658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.703840 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:30.703923 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.704350 (+ 427us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.704450 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:47:30.705399 14271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.691057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33529 (local address 127.12.112.195:49875)
0807 22:47:30.691570 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.691612 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.692482 (+ 870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.693342 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.693352 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.693798 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:30.694467 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.694490 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.695603 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.695608 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.697083 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.697096 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.698007 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.698011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.698219 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.698983 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:30.699009 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:30.700819 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:30.702807 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.702813 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.702825 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.703129 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.703447 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.703449 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.703450 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.703570 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.703935 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:30.703940 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:30.704149 (+ 209us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.704290 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.704547 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":129,"threads_started":1}
I20260807 22:47:30.706586 14387 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33529
I20260807 22:47:30.706738 14387 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:30.707290 14387 heartbeater.cc:511] Master 127.12.112.254:33529 requested a full tablet report, sending...
I20260807 22:47:30.708309 13886 ts_manager.cc:194] Registered new tserver with Master: 09bcc041cec044a89a01928bef5e267e (127.12.112.195:44101)
I20260807 22:47:30.709051 13886 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:49875
I20260807 22:47:30.711624 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 14247
I20260807 22:47:30.711755 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:47:30.712018 12739 external_mini_cluster.cc:1428] Setting key 8af24121056251414dd678e1c9064863
I20260807 22:47:30.714056 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:47:30.716076 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.708782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:51857 (local address 127.12.112.254:33529)
0807 22:47:30.708908 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.708912 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.709108 (+ 196us) server_negotiation.cc:407] Connection header received
0807 22:47:30.709227 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.709230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.709272 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.709370 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:30.709838 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.710600 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.711358 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.711563 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.711679 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.712873 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:30.712876 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:30.712879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:30.712901 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:30.714436 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.714913 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.714915 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.714916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.714985 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.715284 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.715287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.715288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.715495 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:30.715574 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.715884 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.715970 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:47:30.716276 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.708720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33529 (local address 127.12.112.195:51857)
0807 22:47:30.709020 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.709036 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.709145 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.709403 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.709406 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.709616 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:30.709729 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.709735 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.710712 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.710715 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.711256 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.711263 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.711692 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.711696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.711798 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.712300 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:30.712313 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:30.712760 (+ 447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:30.714540 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.714545 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.714547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.714810 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.715068 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:30.715074 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:30.715078 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:30.715185 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:30.715595 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:30.715601 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:30.715713 (+ 112us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.715829 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.715995 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":119,"threads_started":1}
Aug 07 22:47:30 dist-test-slave-tm1g krb5kdc[13837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:47:30 dist-test-slave-tm1g krb5kdc[13837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:30.740923 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.732807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34820 (local address 127.12.112.254:33529)
0807 22:47:30.732931 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.732934 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.732945 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:47:30.732983 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.732986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.733022 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.733085 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:30.733882 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.734485 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.735276 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.735500 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.735589 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.737860 (+ 2271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:30.737863 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:30.737865 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:30.737887 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:30.739247 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.739705 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.739711 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.739715 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.739799 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:30.740077 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:30.740081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:30.740082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:30.740258 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:30.740397 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.740633 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.740749 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:47:30.743728 13886 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34820:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:47:30.746742 13886 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:30.761227 14404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.755120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:33879 (local address 127.0.0.1:55736)
0807 22:47:30.756338 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.756350 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.756548 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.756983 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.756986 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.757002 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:30.757116 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.757124 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.758499 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.758502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.759829 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.759840 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.760690 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.760694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.760801 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.760840 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.760967 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.761087 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1160,"mutex_wait_us":83,"thread_start_us":101,"threads_started":1}
I20260807 22:47:30.761227 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.755286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55736 (local address 127.12.112.193:33879)
0807 22:47:30.755612 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.755621 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.756424 (+ 803us) server_negotiation.cc:407] Connection header received
0807 22:47:30.756693 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.756697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.756848 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.756998 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:30.757249 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.758377 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.759959 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.760568 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.760703 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.760845 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.760997 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.761087 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":87,"threads_started":1}
I20260807 22:47:30.761653 14407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.755560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39316 (local address 127.12.112.195:44101)
0807 22:47:30.755898 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.755907 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.756456 (+ 549us) server_negotiation.cc:407] Connection header received
0807 22:47:30.756537 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.756545 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.756751 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.756908 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:30.757201 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.758083 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.759986 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.760788 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.760937 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.761075 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.761413 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.761512 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":131,"threads_started":1}
I20260807 22:47:30.761724 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.756347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51460 (local address 127.12.112.194:36021)
0807 22:47:30.757236 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.757247 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.757268 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:47:30.757349 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.757354 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.757516 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.757659 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:30.757890 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.758985 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.760146 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.760932 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.761055 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.761165 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.761503 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.761589 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":781,"thread_start_us":109,"threads_started":1}
I20260807 22:47:30.762043 14408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.754918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44101 (local address 127.0.0.1:39316)
0807 22:47:30.756123 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.756173 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.756303 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.756921 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.756930 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.756957 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:30.757097 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.757105 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.758183 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.758188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.759829 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.759840 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.761142 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.761146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.761241 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.761263 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.761850 (+ 587us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.761915 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1041,"mutex_wait_us":106,"thread_start_us":72,"threads_started":1}
I20260807 22:47:30.762043 14405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.755788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:36021 (local address 127.0.0.1:51460)
0807 22:47:30.756735 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.756746 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.756822 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.757659 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.757662 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.757681 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:30.757771 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.757777 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.759114 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.759118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.760024 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.760035 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.761215 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.761218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.761300 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.761330 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.761392 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.761898 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":890,"mutex_wait_us":41,"thread_start_us":114,"threads_started":1}
I20260807 22:47:30.764472 14026 tablet_service.cc:1467] Processing CreateTablet for tablet 6c62924e5aab4b7c86f9aecca573ff39 (DEFAULT_TABLE table=test-table [id=aee80d7272c345869d5850eaeefa0077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:30.765388 14026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c62924e5aab4b7c86f9aecca573ff39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:30.765199 14151 tablet_service.cc:1467] Processing CreateTablet for tablet 6c62924e5aab4b7c86f9aecca573ff39 (DEFAULT_TABLE table=test-table [id=aee80d7272c345869d5850eaeefa0077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:30.765200 14312 tablet_service.cc:1467] Processing CreateTablet for tablet 6c62924e5aab4b7c86f9aecca573ff39 (DEFAULT_TABLE table=test-table [id=aee80d7272c345869d5850eaeefa0077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:30.766160 14151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c62924e5aab4b7c86f9aecca573ff39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:30.766166 14312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c62924e5aab4b7c86f9aecca573ff39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:30.771515 14410 tablet_bootstrap.cc:492] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: Bootstrap starting.
I20260807 22:47:30.773527 14410 tablet_bootstrap.cc:654] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:30.773586 14412 tablet_bootstrap.cc:492] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: Bootstrap starting.
I20260807 22:47:30.774551 14410 log.cc:824] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:30.774611 14411 tablet_bootstrap.cc:492] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: Bootstrap starting.
I20260807 22:47:30.775702 14412 tablet_bootstrap.cc:654] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:30.776463 14412 log.cc:824] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:30.776608 14411 tablet_bootstrap.cc:654] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:30.776664 14410 tablet_bootstrap.cc:492] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: No bootstrap required, opened a new log
I20260807 22:47:30.776865 14410 ts_tablet_manager.cc:1397] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:47:30.777397 14411 log.cc:824] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:30.778410 14412 tablet_bootstrap.cc:492] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: No bootstrap required, opened a new log
I20260807 22:47:30.778600 14412 ts_tablet_manager.cc:1397] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260807 22:47:30.779412 14411 tablet_bootstrap.cc:492] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: No bootstrap required, opened a new log
I20260807 22:47:30.779605 14411 ts_tablet_manager.cc:1397] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:47:30.781623 14410 raft_consensus.cc:348] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } }
I20260807 22:47:30.781895 14410 raft_consensus.cc:374] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:30.781968 14410 raft_consensus.cc:729] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7b2fe88d8a54e0a99ddb969eef84d64, State: Initialized, Role: FOLLOWER
I20260807 22:47:30.781816 14412 raft_consensus.cc:348] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } }
I20260807 22:47:30.782076 14412 raft_consensus.cc:374] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:30.782143 14412 raft_consensus.cc:729] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72d8457626b46d2b179891a006bebda, State: Initialized, Role: FOLLOWER
I20260807 22:47:30.782431 14410 consensus_queue.cc:260] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } }
I20260807 22:47:30.782544 14412 consensus_queue.cc:260] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } }
I20260807 22:47:30.783202 14238 heartbeater.cc:503] Master 127.12.112.254:33529 was elected leader, sending a full tablet report...
I20260807 22:47:30.783445 14410 ts_tablet_manager.cc:1428] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 22:47:30.783399 14411 raft_consensus.cc:348] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } }
I20260807 22:47:30.783635 14411 raft_consensus.cc:374] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:30.783701 14411 raft_consensus.cc:729] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09bcc041cec044a89a01928bef5e267e, State: Initialized, Role: FOLLOWER
I20260807 22:47:30.784018 14411 consensus_queue.cc:260] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } }
I20260807 22:47:30.784256 14095 heartbeater.cc:503] Master 127.12.112.254:33529 was elected leader, sending a full tablet report...
I20260807 22:47:30.784658 14387 heartbeater.cc:503] Master 127.12.112.254:33529 was elected leader, sending a full tablet report...
I20260807 22:47:30.785578 14412 ts_tablet_manager.cc:1428] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:47:30.786321 14411 ts_tablet_manager.cc:1428] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 22:47:30.844421 14418 raft_consensus.cc:482] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:30.844626 14418 raft_consensus.cc:504] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } }
I20260807 22:47:30.845849 14418 leader_election.cc:288] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7b2fe88d8a54e0a99ddb969eef84d64 (127.12.112.193:33879), d72d8457626b46d2b179891a006bebda (127.12.112.194:36021)
I20260807 22:47:30.850625 14271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.846073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:33879 (local address 127.12.112.195:40575)
0807 22:47:30.846197 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.846216 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.846339 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.846664 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.846667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.846692 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:30.846841 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.846848 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.847951 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.847954 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.849341 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.849352 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.850173 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.850175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.850255 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.850275 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.850393 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.850463 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":1}
I20260807 22:47:30.850636 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.846199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:40575 (local address 127.12.112.193:33879)
0807 22:47:30.846411 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.846416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.846433 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:47:30.846505 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.846508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.846556 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.846625 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:30.846960 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.847793 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.849490 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.850055 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.850177 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.850230 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.850411 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.850490 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 22:47:30.851089 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.846416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:34465 (local address 127.12.112.194:36021)
0807 22:47:30.846547 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.846552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.846751 (+ 199us) server_negotiation.cc:407] Connection header received
0807 22:47:30.846850 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.846852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.846892 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.846985 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:30.847225 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.847947 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.849841 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.850471 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.850605 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.850652 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.850872 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.850950 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:47:30.851306 14047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c62924e5aab4b7c86f9aecca573ff39" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" is_pre_election: true
I20260807 22:47:30.851459 14419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.846174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:36021 (local address 127.12.112.195:34465)
0807 22:47:30.846650 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:30.846663 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:30.846753 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:30.847005 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:30.847007 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:30.847022 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:30.847119 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.847123 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.848048 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.848051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.849713 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:30.849721 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.850590 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.850593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:30.850711 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.850733 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:47:30.851238 (+ 505us) client_negotiation.cc:240] Negotiation successful
0807 22:47:30.851315 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":189,"threads_started":1}
I20260807 22:47:30.851686 14047 raft_consensus.cc:2454] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 0.
I20260807 22:47:30.852056 14191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c62924e5aab4b7c86f9aecca573ff39" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72d8457626b46d2b179891a006bebda" is_pre_election: true
I20260807 22:47:30.852237 14265 leader_election.cc:302] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09bcc041cec044a89a01928bef5e267e, a7b2fe88d8a54e0a99ddb969eef84d64; no voters:
I20260807 22:47:30.852373 14191 raft_consensus.cc:2454] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 0.
I20260807 22:47:30.852559 14418 raft_consensus.cc:2781] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:30.852643 14418 raft_consensus.cc:482] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:30.852699 14418 raft_consensus.cc:3037] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:30.853981 14418 raft_consensus.cc:504] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } }
I20260807 22:47:30.854426 14418 leader_election.cc:288] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 election: Requested vote from peers a7b2fe88d8a54e0a99ddb969eef84d64 (127.12.112.193:33879), d72d8457626b46d2b179891a006bebda (127.12.112.194:36021)
I20260807 22:47:30.854763 14191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c62924e5aab4b7c86f9aecca573ff39" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72d8457626b46d2b179891a006bebda"
I20260807 22:47:30.854763 14047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c62924e5aab4b7c86f9aecca573ff39" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64"
I20260807 22:47:30.854887 14191 raft_consensus.cc:3037] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:30.854887 14047 raft_consensus.cc:3037] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:30.856281 14047 raft_consensus.cc:2454] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 1.
I20260807 22:47:30.856570 14265 leader_election.cc:302] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09bcc041cec044a89a01928bef5e267e, a7b2fe88d8a54e0a99ddb969eef84d64; no voters:
I20260807 22:47:30.856714 14191 raft_consensus.cc:2454] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 1.
I20260807 22:47:30.856804 14418 raft_consensus.cc:2781] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:30.857074 14418 raft_consensus.cc:686] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 1 LEADER]: Becoming Leader. State: Replica: 09bcc041cec044a89a01928bef5e267e, State: Running, Role: LEADER
I20260807 22:47:30.857422 14418 consensus_queue.cc:237] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } }
I20260807 22:47:30.860466 13886 catalog_manager.cc:5495] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e reported cstate change: term changed from 0 to 1, leader changed from <none> to 09bcc041cec044a89a01928bef5e267e (127.12.112.195). New cstate: current_term: 1 leader_uuid: "09bcc041cec044a89a01928bef5e267e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } health_report { overall_health: UNKNOWN } } }
I20260807 22:47:30.890856 14407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:30.887263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39318 (local address 127.12.112.195:44101)
0807 22:47:30.887398 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:30.887402 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:30.887415 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:47:30.887568 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:30.887571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:30.887623 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:30.887711 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:30.887942 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.888455 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.889294 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:30.889518 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:30.889599 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:30.889940 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:30.890438 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:30.890542 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:30.890686 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 22:47:30.890743 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:47:30.896593 14191 raft_consensus.cc:1261] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda [term 1 FOLLOWER]: Refusing update from remote peer 09bcc041cec044a89a01928bef5e267e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:30.896593 14047 raft_consensus.cc:1261] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 1 FOLLOWER]: Refusing update from remote peer 09bcc041cec044a89a01928bef5e267e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:30.897334 14420 consensus_queue.cc:1035] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:30.897533 14418 consensus_queue.cc:1035] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:30.907423 14425 mvcc.cc:205] Tried to move back new op lower bound from 7316041117265436672 to 7316041117114535936. Current Snapshot: MvccSnapshot[applied={T|T < 7316041117265436672}]
I20260807 22:47:30.916525 13886 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:30.916735 13886 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:30.919137 13886 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863: Sending DeleteTablet for 3 replicas of tablet 6c62924e5aab4b7c86f9aecca573ff39
I20260807 22:47:30.919857 14312 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c62924e5aab4b7c86f9aecca573ff39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:30 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:39316
I20260807 22:47:30.919893 14151 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c62924e5aab4b7c86f9aecca573ff39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:30 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:51460
I20260807 22:47:30.919929 14026 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c62924e5aab4b7c86f9aecca573ff39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:30 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:55736
I20260807 22:47:30.920363 14433 tablet_replica.cc:330] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: stopping tablet replica
I20260807 22:47:30.920670 14433 raft_consensus.cc:2229] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:47:30.920723 14434 tablet_replica.cc:330] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: stopping tablet replica
I20260807 22:47:30.920975 14434 raft_consensus.cc:2229] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:30.921003 14433 raft_consensus.cc:2258] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:30.921268 14434 raft_consensus.cc:2258] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:30.921312 13886 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34820:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:47:30.921705 13886 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:30.922842 14434 ts_tablet_manager.cc:1905] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:30.923292 14433 ts_tablet_manager.cc:1905] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:30.926514 14434 ts_tablet_manager.cc:1918] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:47:30.926615 14434 log.cc:1196] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/6c62924e5aab4b7c86f9aecca573ff39
I20260807 22:47:30.926844 14312 tablet_service.cc:1467] Processing CreateTablet for tablet 67e8b7747892433588c0f3a9d0891f76 (DEFAULT_TABLE table=test-table [id=2e57876c04a54a4391bd2f8271d80d74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:30.927012 14026 tablet_service.cc:1467] Processing CreateTablet for tablet 67e8b7747892433588c0f3a9d0891f76 (DEFAULT_TABLE table=test-table [id=2e57876c04a54a4391bd2f8271d80d74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:30.927085 14312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67e8b7747892433588c0f3a9d0891f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:30.927155 14151 tablet_service.cc:1467] Processing CreateTablet for tablet 67e8b7747892433588c0f3a9d0891f76 (DEFAULT_TABLE table=test-table [id=2e57876c04a54a4391bd2f8271d80d74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:30.927285 14026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67e8b7747892433588c0f3a9d0891f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:30.927373 14151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67e8b7747892433588c0f3a9d0891f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:30.929361 14411 tablet_bootstrap.cc:492] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: Bootstrap starting.
I20260807 22:47:30.929515 14412 tablet_bootstrap.cc:492] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: Bootstrap starting.
I20260807 22:47:30.929869 14434 ts_tablet_manager.cc:1939] T 6c62924e5aab4b7c86f9aecca573ff39 P d72d8457626b46d2b179891a006bebda: Deleting consensus metadata
I20260807 22:47:30.930317 14410 tablet_bootstrap.cc:492] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: Bootstrap starting.
I20260807 22:47:30.930387 14411 tablet_bootstrap.cc:654] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:30.930816 14412 tablet_bootstrap.cc:654] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:30.931371 14410 tablet_bootstrap.cc:654] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:30.931617 13868 catalog_manager.cc:4841] TS d72d8457626b46d2b179891a006bebda (127.12.112.194:36021): tablet 6c62924e5aab4b7c86f9aecca573ff39 (table test-table [id=aee80d7272c345869d5850eaeefa0077]) successfully deleted
I20260807 22:47:30.931835 14433 ts_tablet_manager.cc:1918] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:47:30.931932 14433 log.cc:1196] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/6c62924e5aab4b7c86f9aecca573ff39
I20260807 22:47:30.932245 14433 ts_tablet_manager.cc:1939] T 6c62924e5aab4b7c86f9aecca573ff39 P 09bcc041cec044a89a01928bef5e267e: Deleting consensus metadata
I20260807 22:47:30.933256 13870 catalog_manager.cc:4841] TS 09bcc041cec044a89a01928bef5e267e (127.12.112.195:44101): tablet 6c62924e5aab4b7c86f9aecca573ff39 (table test-table [id=aee80d7272c345869d5850eaeefa0077]) successfully deleted
I20260807 22:47:30.933311 14435 tablet_replica.cc:330] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: stopping tablet replica
I20260807 22:47:30.933574 14435 raft_consensus.cc:2229] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:30.933912 14435 raft_consensus.cc:2258] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:30.934962 14412 tablet_bootstrap.cc:492] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: No bootstrap required, opened a new log
I20260807 22:47:30.935050 14412 ts_tablet_manager.cc:1397] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260807 22:47:30.935313 14435 ts_tablet_manager.cc:1905] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:30.935488 14412 raft_consensus.cc:348] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:30.935606 14412 raft_consensus.cc:374] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:30.935649 14412 raft_consensus.cc:729] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72d8457626b46d2b179891a006bebda, State: Initialized, Role: FOLLOWER
I20260807 22:47:30.935762 14412 consensus_queue.cc:260] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:30.935997 14412 ts_tablet_manager.cc:1428] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:47:30.937947 14435 ts_tablet_manager.cc:1918] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:47:30.938038 14435 log.cc:1196] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/6c62924e5aab4b7c86f9aecca573ff39
I20260807 22:47:30.938380 14435 ts_tablet_manager.cc:1939] T 6c62924e5aab4b7c86f9aecca573ff39 P a7b2fe88d8a54e0a99ddb969eef84d64: Deleting consensus metadata
I20260807 22:47:30.939060 14410 tablet_bootstrap.cc:492] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: No bootstrap required, opened a new log
I20260807 22:47:30.939141 14410 ts_tablet_manager.cc:1397] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260807 22:47:30.939357 14411 tablet_bootstrap.cc:492] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: No bootstrap required, opened a new log
I20260807 22:47:30.939440 14411 ts_tablet_manager.cc:1397] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20260807 22:47:30.939792 14411 raft_consensus.cc:348] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:30.939881 14411 raft_consensus.cc:374] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:30.939818 14410 raft_consensus.cc:348] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:30.939903 14411 raft_consensus.cc:729] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09bcc041cec044a89a01928bef5e267e, State: Initialized, Role: FOLLOWER
I20260807 22:47:30.939919 14410 raft_consensus.cc:374] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:30.939949 14410 raft_consensus.cc:729] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7b2fe88d8a54e0a99ddb969eef84d64, State: Initialized, Role: FOLLOWER
I20260807 22:47:30.940047 14411 consensus_queue.cc:260] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:30.940202 13869 catalog_manager.cc:4841] TS a7b2fe88d8a54e0a99ddb969eef84d64 (127.12.112.193:33879): tablet 6c62924e5aab4b7c86f9aecca573ff39 (table test-table [id=aee80d7272c345869d5850eaeefa0077]) successfully deleted
I20260807 22:47:30.940318 14411 ts_tablet_manager.cc:1428] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:47:30.940937 14410 consensus_queue.cc:260] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:30.941995 14410 ts_tablet_manager.cc:1428] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
W20260807 22:47:30.953013 14388 tablet.cc:2369] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:47:30.957254 14239 tablet.cc:2369] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:47:30.989656 14096 tablet.cc:2369] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:47:31.031921 14420 raft_consensus.cc:482] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:31.032063 14420 raft_consensus.cc:504] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.032558 14420 leader_election.cc:288] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7b2fe88d8a54e0a99ddb969eef84d64 (127.12.112.193:33879), d72d8457626b46d2b179891a006bebda (127.12.112.194:36021)
I20260807 22:47:31.033007 14047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e8b7747892433588c0f3a9d0891f76" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" is_pre_election: true
I20260807 22:47:31.033035 14191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e8b7747892433588c0f3a9d0891f76" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72d8457626b46d2b179891a006bebda" is_pre_election: true
I20260807 22:47:31.033179 14047 raft_consensus.cc:2454] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 0.
I20260807 22:47:31.033205 14191 raft_consensus.cc:2454] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 0.
I20260807 22:47:31.033464 14265 leader_election.cc:302] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09bcc041cec044a89a01928bef5e267e, a7b2fe88d8a54e0a99ddb969eef84d64; no voters:
I20260807 22:47:31.033701 14420 raft_consensus.cc:2781] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:31.033771 14420 raft_consensus.cc:482] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:31.033824 14420 raft_consensus.cc:3037] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:31.034899 14420 raft_consensus.cc:504] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.035243 14420 leader_election.cc:288] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 election: Requested vote from peers a7b2fe88d8a54e0a99ddb969eef84d64 (127.12.112.193:33879), d72d8457626b46d2b179891a006bebda (127.12.112.194:36021)
I20260807 22:47:31.035576 14047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e8b7747892433588c0f3a9d0891f76" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64"
I20260807 22:47:31.035576 14191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e8b7747892433588c0f3a9d0891f76" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72d8457626b46d2b179891a006bebda"
I20260807 22:47:31.035698 14191 raft_consensus.cc:3037] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:31.035701 14047 raft_consensus.cc:3037] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:31.036578 14047 raft_consensus.cc:2454] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 1.
I20260807 22:47:31.036931 14191 raft_consensus.cc:2454] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 1.
I20260807 22:47:31.037263 14264 leader_election.cc:302] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09bcc041cec044a89a01928bef5e267e, d72d8457626b46d2b179891a006bebda; no voters:
I20260807 22:47:31.037465 14420 raft_consensus.cc:2781] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:31.037576 14420 raft_consensus.cc:686] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 1 LEADER]: Becoming Leader. State: Replica: 09bcc041cec044a89a01928bef5e267e, State: Running, Role: LEADER
I20260807 22:47:31.037708 14420 consensus_queue.cc:237] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.039364 13886 catalog_manager.cc:5495] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e reported cstate change: term changed from 0 to 1, leader changed from <none> to 09bcc041cec044a89a01928bef5e267e (127.12.112.195). New cstate: current_term: 1 leader_uuid: "09bcc041cec044a89a01928bef5e267e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } health_report { overall_health: HEALTHY } } }
Aug 07 22:47:31 dist-test-slave-tm1g krb5kdc[13837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142849, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:31.084623 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:31.076357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34828 (local address 127.12.112.254:33529)
0807 22:47:31.076498 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:31.076503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:31.076650 (+ 147us) server_negotiation.cc:407] Connection header received
0807 22:47:31.076755 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:31.076757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:31.076796 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:31.076865 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:31.077557 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.078126 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.078952 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.079164 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.079245 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:31.081539 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:31.081542 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:31.081544 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:31.081565 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:31.083052 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:31.083502 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:31.083504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:31.083506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:31.083581 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:31.083841 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:31.083844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:31.083845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:31.084008 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:31.084081 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:31.084364 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 22:47:31.084493 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":59}
I20260807 22:47:31.084625 14445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:31.076267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33529 (local address 127.0.0.1:34828)
0807 22:47:31.076562 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:31.076574 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:31.076686 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:31.076901 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:31.076903 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:31.077284 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:31.077425 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:31.077431 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.078236 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.078239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:31.078846 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:31.078855 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.079261 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.079264 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:31.079358 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:31.079931 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:31.079943 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:31.081400 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:31.083152 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:31.083160 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:31.083165 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:31.083409 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:31.083667 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:31.083669 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:31.083670 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:31.083760 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:31.084102 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:31.084107 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:31.084210 (+ 103us) client_negotiation.cc:769] Sending connection context
0807 22:47:31.084310 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 22:47:31.084435 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":131,"threads_started":1}
I20260807 22:47:31.088610 13886 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:34828:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 22:47:31.089308 13886 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:31.094154 14312 tablet_service.cc:1467] Processing CreateTablet for tablet 9d0e57651a3a4ebc94dcaa56fd96577a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=49cbf2ea176c424dbfb9185507d05909]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:47:31.094154 14026 tablet_service.cc:1467] Processing CreateTablet for tablet 9d0e57651a3a4ebc94dcaa56fd96577a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=49cbf2ea176c424dbfb9185507d05909]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:47:31.094174 14151 tablet_service.cc:1467] Processing CreateTablet for tablet 9d0e57651a3a4ebc94dcaa56fd96577a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=49cbf2ea176c424dbfb9185507d05909]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:47:31.094597 14026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d0e57651a3a4ebc94dcaa56fd96577a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:31.094599 14312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d0e57651a3a4ebc94dcaa56fd96577a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:31.094642 14151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d0e57651a3a4ebc94dcaa56fd96577a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:31.097256 14412 tablet_bootstrap.cc:492] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: Bootstrap starting.
I20260807 22:47:31.097419 14410 tablet_bootstrap.cc:492] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: Bootstrap starting.
I20260807 22:47:31.097760 14411 tablet_bootstrap.cc:492] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: Bootstrap starting.
I20260807 22:47:31.098383 14412 tablet_bootstrap.cc:654] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:31.098423 14410 tablet_bootstrap.cc:654] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:31.098697 14411 tablet_bootstrap.cc:654] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:31.099735 14412 tablet_bootstrap.cc:492] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: No bootstrap required, opened a new log
I20260807 22:47:31.099829 14412 ts_tablet_manager.cc:1397] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 22:47:31.099947 14411 tablet_bootstrap.cc:492] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: No bootstrap required, opened a new log
I20260807 22:47:31.100031 14410 tablet_bootstrap.cc:492] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: No bootstrap required, opened a new log
I20260807 22:47:31.100046 14411 ts_tablet_manager.cc:1397] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:31.100114 14410 ts_tablet_manager.cc:1397] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:47:31.100323 14412 raft_consensus.cc:348] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.100447 14412 raft_consensus.cc:374] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:31.100405 14411 raft_consensus.cc:348] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.100492 14412 raft_consensus.cc:729] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72d8457626b46d2b179891a006bebda, State: Initialized, Role: FOLLOWER
I20260807 22:47:31.100524 14411 raft_consensus.cc:374] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:31.100556 14411 raft_consensus.cc:729] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09bcc041cec044a89a01928bef5e267e, State: Initialized, Role: FOLLOWER
I20260807 22:47:31.100577 14410 raft_consensus.cc:348] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.100620 14412 consensus_queue.cc:260] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.100684 14410 raft_consensus.cc:374] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:31.100720 14410 raft_consensus.cc:729] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7b2fe88d8a54e0a99ddb969eef84d64, State: Initialized, Role: FOLLOWER
I20260807 22:47:31.100669 14411 consensus_queue.cc:260] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.100836 14410 consensus_queue.cc:260] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.100915 14412 ts_tablet_manager.cc:1428] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:47:31.100934 14411 ts_tablet_manager.cc:1428] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:47:31.101173 14410 ts_tablet_manager.cc:1428] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:47:31.101440 14417 tablet_replica.cc:439] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } }
I20260807 22:47:31.101580 14417 tablet_replica.cc:442] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:31.101780 14416 tablet_replica.cc:439] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } }
I20260807 22:47:31.101919 14416 tablet_replica.cc:442] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:31.102221 14420 tablet_replica.cc:439] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } }
I20260807 22:47:31.102388 14420 tablet_replica.cc:442] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:31.201365 14420 raft_consensus.cc:482] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:31.201498 14420 raft_consensus.cc:504] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.201963 14420 leader_election.cc:288] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7b2fe88d8a54e0a99ddb969eef84d64 (127.12.112.193:33879), d72d8457626b46d2b179891a006bebda (127.12.112.194:36021)
I20260807 22:47:31.202411 14191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d0e57651a3a4ebc94dcaa56fd96577a" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72d8457626b46d2b179891a006bebda" is_pre_election: true
I20260807 22:47:31.202414 14047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d0e57651a3a4ebc94dcaa56fd96577a" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" is_pre_election: true
I20260807 22:47:31.202574 14191 raft_consensus.cc:2454] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 0.
I20260807 22:47:31.202590 14047 raft_consensus.cc:2454] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 0.
I20260807 22:47:31.202907 14264 leader_election.cc:302] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09bcc041cec044a89a01928bef5e267e, d72d8457626b46d2b179891a006bebda; no voters:
I20260807 22:47:31.203089 14420 raft_consensus.cc:2781] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:31.203150 14420 raft_consensus.cc:482] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:31.203177 14420 raft_consensus.cc:3037] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:31.204195 14420 raft_consensus.cc:504] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.204562 14420 leader_election.cc:288] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 election: Requested vote from peers a7b2fe88d8a54e0a99ddb969eef84d64 (127.12.112.193:33879), d72d8457626b46d2b179891a006bebda (127.12.112.194:36021)
I20260807 22:47:31.204879 14047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d0e57651a3a4ebc94dcaa56fd96577a" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64"
I20260807 22:47:31.204954 14191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d0e57651a3a4ebc94dcaa56fd96577a" candidate_uuid: "09bcc041cec044a89a01928bef5e267e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72d8457626b46d2b179891a006bebda"
I20260807 22:47:31.204990 14047 raft_consensus.cc:3037] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:31.205085 14191 raft_consensus.cc:3037] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:31.205925 14047 raft_consensus.cc:2454] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 1.
I20260807 22:47:31.206058 14191 raft_consensus.cc:2454] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09bcc041cec044a89a01928bef5e267e in term 1.
I20260807 22:47:31.206230 14265 leader_election.cc:302] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09bcc041cec044a89a01928bef5e267e, a7b2fe88d8a54e0a99ddb969eef84d64; no voters:
I20260807 22:47:31.206416 14420 raft_consensus.cc:2781] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:31.206516 14420 raft_consensus.cc:686] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [term 1 LEADER]: Becoming Leader. State: Replica: 09bcc041cec044a89a01928bef5e267e, State: Running, Role: LEADER
I20260807 22:47:31.206653 14420 consensus_queue.cc:237] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } }
I20260807 22:47:31.207309 14418 tablet_replica.cc:439] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: TxnStatusTablet state changed. Reason: New leader 09bcc041cec044a89a01928bef5e267e. Latest consensus state: current_term: 1 leader_uuid: "09bcc041cec044a89a01928bef5e267e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } }
I20260807 22:47:31.207436 14418 tablet_replica.cc:442] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:47:31.207736 14450 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 22:47:31.207981 14450 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 22:47:31.208582 13885 catalog_manager.cc:5495] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e reported cstate change: term changed from 0 to 1, leader changed from <none> to 09bcc041cec044a89a01928bef5e267e (127.12.112.195). New cstate: current_term: 1 leader_uuid: "09bcc041cec044a89a01928bef5e267e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } health_report { overall_health: HEALTHY } } }
I20260807 22:47:31.223163 14445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:31.219713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44101 (local address 127.0.0.1:39334)
0807 22:47:31.219859 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:31.219875 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:31.219977 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:31.220236 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:31.220238 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:31.220245 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:47:31.220348 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:31.220352 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.221322 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.221324 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:31.221919 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:31.221926 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.222516 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.222519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:31.222594 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:31.222637 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:47:31.222924 (+ 287us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:47:31.222942 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 22:47:31.222989 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 22:47:31.223058 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 22:47:31.223198 14407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:31.219772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39334 (local address 127.12.112.195:44101)
0807 22:47:31.219912 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:31.219917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:31.219932 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:47:31.220085 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:31.220088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:31.220139 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:31.220220 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:31.220440 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.221229 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.222032 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.222395 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.222520 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:31.222755 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:31.222841 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:31.222905 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:31.223026 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 22:47:31.223077 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:47:31.225558 14191 raft_consensus.cc:1261] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda [term 1 FOLLOWER]: Refusing update from remote peer 09bcc041cec044a89a01928bef5e267e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:31.225561 14047 raft_consensus.cc:1261] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64 [term 1 FOLLOWER]: Refusing update from remote peer 09bcc041cec044a89a01928bef5e267e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:31.225970 14418 consensus_queue.cc:1035] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:31.226123 14420 consensus_queue.cc:1035] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:31.228084 14416 tablet_replica.cc:439] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: TxnStatusTablet state changed. Reason: New leader 09bcc041cec044a89a01928bef5e267e. Latest consensus state: current_term: 1 leader_uuid: "09bcc041cec044a89a01928bef5e267e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } }
I20260807 22:47:31.228215 14416 tablet_replica.cc:442] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:31.228724 14417 tablet_replica.cc:439] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: TxnStatusTablet state changed. Reason: New leader 09bcc041cec044a89a01928bef5e267e. Latest consensus state: current_term: 1 leader_uuid: "09bcc041cec044a89a01928bef5e267e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } }
I20260807 22:47:31.228845 14417 tablet_replica.cc:442] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:31.230024 14420 tablet_replica.cc:439] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "09bcc041cec044a89a01928bef5e267e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } }
I20260807 22:47:31.230126 14420 tablet_replica.cc:442] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:47:31.230207 14424 mvcc.cc:205] Tried to move back new op lower bound from 7316041118616342528 to 7316041118543949824. Current Snapshot: MvccSnapshot[applied={T|T < 7316041118616342528}]
I20260807 22:47:31.230456 14417 tablet_replica.cc:439] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "09bcc041cec044a89a01928bef5e267e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } }
I20260807 22:47:31.230545 14417 tablet_replica.cc:442] T 9d0e57651a3a4ebc94dcaa56fd96577a P d72d8457626b46d2b179891a006bebda: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:31.233253 14418 tablet_replica.cc:439] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "09bcc041cec044a89a01928bef5e267e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } }
I20260807 22:47:31.233367 14418 tablet_replica.cc:442] T 9d0e57651a3a4ebc94dcaa56fd96577a P 09bcc041cec044a89a01928bef5e267e: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:47:31.234077 14416 tablet_replica.cc:439] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "09bcc041cec044a89a01928bef5e267e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 } } peers { permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 } } peers { permanent_uuid: "09bcc041cec044a89a01928bef5e267e" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44101 } } }
I20260807 22:47:31.234192 14416 tablet_replica.cc:442] T 9d0e57651a3a4ebc94dcaa56fd96577a P a7b2fe88d8a54e0a99ddb969eef84d64: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:31.234163 14426 mvcc.cc:205] Tried to move back new op lower bound from 7316041118616342528 to 7316041118543949824. Current Snapshot: MvccSnapshot[applied={T|T < 7316041118616342528}]
I20260807 22:47:31.245590 14407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:31.241957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:46467 (local address 127.12.112.195:44101)
0807 22:47:31.242092 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:31.242097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:31.242569 (+ 472us) server_negotiation.cc:407] Connection header received
0807 22:47:31.242749 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:31.242752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:31.242791 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:31.242866 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:31.243081 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.243701 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.244529 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.244748 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.244846 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:31.245173 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:31.245246 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:31.245330 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:31.245407 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 22:47:31.245460 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":44}
I20260807 22:47:31.245609 14457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:31.241921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44101 (local address 127.12.112.195:46467)
0807 22:47:31.242489 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:31.242501 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:31.242621 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:31.242883 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:31.242886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:31.242893 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:47:31.242984 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:31.242990 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.243796 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.243802 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:31.244409 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:31.244417 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.244854 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.244857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:31.245016 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:31.245052 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:47:31.245331 (+ 279us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:47:31.245338 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:47:31.245402 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 22:47:31.245478 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":22,"thread_start_us":129,"threads_started":1}
I20260807 22:47:31.252285 14047 raft_consensus.cc:1261] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 1 FOLLOWER]: Refusing update from remote peer 09bcc041cec044a89a01928bef5e267e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:31.252710 14191 raft_consensus.cc:1261] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda [term 1 FOLLOWER]: Refusing update from remote peer 09bcc041cec044a89a01928bef5e267e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:31.253046 14418 consensus_queue.cc:1035] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7b2fe88d8a54e0a99ddb969eef84d64" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:31.253163 14420 consensus_queue.cc:1035] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d72d8457626b46d2b179891a006bebda" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:31.292385 13882 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:31.292562 13882 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:31.294690 13882 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6d65200fbfc642c798ef2b5eb0504863: Sending DeleteTablet for 3 replicas of tablet 67e8b7747892433588c0f3a9d0891f76
I20260807 22:47:31.295198 14026 tablet_service.cc:1514] Processing DeleteTablet for tablet 67e8b7747892433588c0f3a9d0891f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:31 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:55736
I20260807 22:47:31.295375 14312 tablet_service.cc:1514] Processing DeleteTablet for tablet 67e8b7747892433588c0f3a9d0891f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:31 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:39316
I20260807 22:47:31.295392 14151 tablet_service.cc:1514] Processing DeleteTablet for tablet 67e8b7747892433588c0f3a9d0891f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:31 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:51460
I20260807 22:47:31.295574 14435 tablet_replica.cc:330] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: stopping tablet replica
I20260807 22:47:31.295569 14434 tablet_replica.cc:330] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: stopping tablet replica
I20260807 22:47:31.295696 14434 raft_consensus.cc:2229] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:31.295708 14435 raft_consensus.cc:2229] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:31.295818 14434 raft_consensus.cc:2258] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:31.295830 14435 raft_consensus.cc:2258] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:31.296490 14433 tablet_replica.cc:330] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: stopping tablet replica
I20260807 22:47:31.296586 14434 ts_tablet_manager.cc:1905] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:31.296614 14433 raft_consensus.cc:2229] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:47:31.296624 14435 ts_tablet_manager.cc:1905] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:31.296774 14433 raft_consensus.cc:2258] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:31.297420 14433 ts_tablet_manager.cc:1905] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:31.299372 14434 ts_tablet_manager.cc:1918] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:47:31.299372 14435 ts_tablet_manager.cc:1918] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:47:31.299445 14434 log.cc:1196] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/67e8b7747892433588c0f3a9d0891f76
I20260807 22:47:31.299454 14435 log.cc:1196] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/67e8b7747892433588c0f3a9d0891f76
I20260807 22:47:31.299717 14435 ts_tablet_manager.cc:1939] T 67e8b7747892433588c0f3a9d0891f76 P a7b2fe88d8a54e0a99ddb969eef84d64: Deleting consensus metadata
I20260807 22:47:31.299717 14434 ts_tablet_manager.cc:1939] T 67e8b7747892433588c0f3a9d0891f76 P d72d8457626b46d2b179891a006bebda: Deleting consensus metadata
I20260807 22:47:31.300052 14433 ts_tablet_manager.cc:1918] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:47:31.300119 14433 log.cc:1196] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/67e8b7747892433588c0f3a9d0891f76
I20260807 22:47:31.300390 13869 catalog_manager.cc:4841] TS a7b2fe88d8a54e0a99ddb969eef84d64 (127.12.112.193:33879): tablet 67e8b7747892433588c0f3a9d0891f76 (table test-table [id=2e57876c04a54a4391bd2f8271d80d74]) successfully deleted
I20260807 22:47:31.300447 13868 catalog_manager.cc:4841] TS d72d8457626b46d2b179891a006bebda (127.12.112.194:36021): tablet 67e8b7747892433588c0f3a9d0891f76 (table test-table [id=2e57876c04a54a4391bd2f8271d80d74]) successfully deleted
I20260807 22:47:31.300951 14433 ts_tablet_manager.cc:1939] T 67e8b7747892433588c0f3a9d0891f76 P 09bcc041cec044a89a01928bef5e267e: Deleting consensus metadata
I20260807 22:47:31.301559 13870 catalog_manager.cc:4841] TS 09bcc041cec044a89a01928bef5e267e (127.12.112.195:44101): tablet 67e8b7747892433588c0f3a9d0891f76 (table test-table [id=2e57876c04a54a4391bd2f8271d80d74]) successfully deleted
Aug 07 22:47:31 dist-test-slave-tm1g krb5kdc[13837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:47:31.312834 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:31.300633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55746 (local address 127.12.112.193:33879)
0807 22:47:31.300746 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:31.300751 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:31.302567 (+ 1816us) server_negotiation.cc:407] Connection header received
0807 22:47:31.302656 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:31.302659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:31.302707 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:31.302786 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:31.303470 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.304254 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.305081 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.305438 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.305541 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:31.309207 (+ 3666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:31.309217 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:31.309232 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:31.309265 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:31.311041 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:31.311508 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:31.311514 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:31.311515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:31.311595 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:31.311869 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:31.311871 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:31.311873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:31.312111 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:31.312317 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:31.312547 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 22:47:31.312653 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 22:47:31.313445 14088 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55746
I20260807 22:47:31.322970 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:31.315250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34836 (local address 127.12.112.254:33529)
0807 22:47:31.315383 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:31.315387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:31.315438 (+ 51us) server_negotiation.cc:407] Connection header received
0807 22:47:31.315547 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:31.315550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:31.315597 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:31.315664 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:31.316246 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.317116 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.317891 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:31.318175 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:31.318271 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:31.319642 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:31.319646 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:31.319648 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:31.319675 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:31.321241 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:31.321651 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:31.321661 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:31.321663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:31.321769 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:31.322075 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:31.322078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:31.322080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:31.322294 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:31.322485 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:31.322672 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 22:47:31.322793 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260807 22:47:31.323380 13882 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34836
I20260807 22:47:31.324788 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 13960
I20260807 22:47:31.332948 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 14104
I20260807 22:47:31.341434 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 14247
I20260807 22:47:31.349759 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 13850
2026-08-07T22:47:31Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2749 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:31 dist-test-slave-tm1g krb5kdc[14469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:31 dist-test-slave-tm1g krb5kdc[14469](info): set up 2 sockets
Aug 07 22:47:31 dist-test-slave-tm1g krb5kdc[14469](info): commencing operation
krb5kdc: starting...
W20260807 22:47:32.417742 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:32 dist-test-slave-tm1g krb5kdc[14469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:47:32.545506 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:34309
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:42111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:34309
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:32.656476 14482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:32.656745 14482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:32.656787 14482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:32.660912 14482 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:32.660974 14482 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 22:47:32.660992 14482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:32.661011 14482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:32.661027 14482 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:32.661084 14482 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:32.666354 14482 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:42111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:34309
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:34309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:32.667440 14482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:32.668483 14482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:32.677188 14487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:32.677165 14488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:32.677165 14490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:32.677501 14482 server_base.cc:1034] running on GCE node
I20260807 22:47:32.678013 14482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:32.679155 14482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:32.680363 14482 hybrid_clock.cc:648] HybridClock initialized: now 1786142852680349 us; error 36 us; skew 500 ppm
Aug 07 22:47:32 dist-test-slave-tm1g krb5kdc[14469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142852, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:32.683226 14482 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:47:32.684046 14482 webserver.cc:460] Webserver started at http://127.12.112.254:33395/ using document root <none> and password file <none>
I20260807 22:47:32.684561 14482 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:32.684616 14482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:32.684793 14482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:32.686832 14482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82"
format_stamp: "Formatted at 2026-08-07 22:47:32 on dist-test-slave-tm1g"
server_key: "8d4a22584141e617229297a041d08222"
server_key_iv: "c67f2358fb6a2ec0ff40ccad2d205344"
server_key_version: "encryptionkey@0"
I20260807 22:47:32.687328 14482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82"
format_stamp: "Formatted at 2026-08-07 22:47:32 on dist-test-slave-tm1g"
server_key: "8d4a22584141e617229297a041d08222"
server_key_iv: "c67f2358fb6a2ec0ff40ccad2d205344"
server_key_version: "encryptionkey@0"
I20260807 22:47:32.691402 14482 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260807 22:47:32.693617 14497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:32.694885 14482 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:32.694983 14482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82"
format_stamp: "Formatted at 2026-08-07 22:47:32 on dist-test-slave-tm1g"
server_key: "8d4a22584141e617229297a041d08222"
server_key_iv: "c67f2358fb6a2ec0ff40ccad2d205344"
server_key_version: "encryptionkey@0"
I20260807 22:47:32.695067 14482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:32.705792 14482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:32.708804 14482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:32.708952 14482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:32.716719 14482 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:34309
I20260807 22:47:32.716745 14560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:34309 every 8 connection(s)
I20260807 22:47:32.717615 14482 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:32.720301 14561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:32.722047 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 14482
I20260807 22:47:32.722143 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:32.722456 12739 external_mini_cluster.cc:1428] Setting key a76008726b6bcc3d08b8bd8a6bfaa808
I20260807 22:47:32.726627 14561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82: Bootstrap starting.
I20260807 22:47:32.728781 14561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:32.729483 14561 log.cc:824] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:47:32 dist-test-slave-tm1g krb5kdc[14469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:32.731443 14561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82: No bootstrap required, opened a new log
I20260807 22:47:32.735744 14561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34309 } }
I20260807 22:47:32.736065 14561 raft_consensus.cc:374] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:32.736128 14561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024d0f08d9c44b1fa1c19c2d2feb6c82, State: Initialized, Role: FOLLOWER
I20260807 22:47:32.736613 14561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34309 } }
I20260807 22:47:32.736768 14561 raft_consensus.cc:388] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:32.736830 14561 raft_consensus.cc:482] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:32.736932 14561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:32.737633 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:32.723836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54080 (local address 127.12.112.254:34309)
0807 22:47:32.724300 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:32.724315 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:32.724353 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:47:32.724996 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:32.725012 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:32.725344 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:32.725689 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:32.726555 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:32.727566 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:32.728468 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:32.729003 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:32.729169 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:32.731696 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:32.731702 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:32.731718 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:32.731750 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:32.734479 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:32.734897 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:32.734903 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:32.734909 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:32.735055 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:32.735320 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:32.735323 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:32.735325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:32.735841 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:32.736052 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:32.736354 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 22:47:32.736658 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":153,"threads_started":1}
I20260807 22:47:32.738034 14561 raft_consensus.cc:504] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34309 } }
I20260807 22:47:32.738391 14561 leader_election.cc:302] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 024d0f08d9c44b1fa1c19c2d2feb6c82; no voters:
I20260807 22:47:32.738713 14561 leader_election.cc:288] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:32.738830 14566 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:32.739037 14566 raft_consensus.cc:686] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [term 1 LEADER]: Becoming Leader. State: Replica: 024d0f08d9c44b1fa1c19c2d2feb6c82, State: Running, Role: LEADER
I20260807 22:47:32.739394 14566 consensus_queue.cc:237] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34309 } }
I20260807 22:47:32.740270 14561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:32.741226 14568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 024d0f08d9c44b1fa1c19c2d2feb6c82. Latest consensus state: current_term: 1 leader_uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34309 } } }
I20260807 22:47:32.741250 14567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024d0f08d9c44b1fa1c19c2d2feb6c82" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34309 } } }
I20260807 22:47:32.741387 14567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:32.741387 14568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:32.741776 14575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:32.744655 14575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:32.750099 14575 catalog_manager.cc:1347] Generated new cluster ID: 5eab50e2f2e949d29583f6d49bd8e0a3
I20260807 22:47:32.750172 14575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:32.760408 14575 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:32.761653 14575 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:32.767696 14575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82: Generated new TSK 0
I20260807 22:47:32.768332 14575 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:47:32.795869 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34309
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:42111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:32.909204 14588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:32.909471 14588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:32.909543 14588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:32.913628 14588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:32.913688 14588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:32.913729 14588 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 22:47:32.913744 14588 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:47:32.913818 14588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:32.919102 14588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:42111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.112.254:34309
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:32.920152 14588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:32.921187 14588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:47:32.930778 14588 server_base.cc:1034] running on GCE node
W20260807 22:47:32.930727 14596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:32.930714 14593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:32.930743 14594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:32.931488 14588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:32.932204 14588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:32.933405 14588 hybrid_clock.cc:648] HybridClock initialized: now 1786142852933374 us; error 27 us; skew 500 ppm
Aug 07 22:47:32 dist-test-slave-tm1g krb5kdc[14469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142852, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:32.936254 14588 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:47:32.937093 14588 webserver.cc:460] Webserver started at http://127.12.112.193:45475/ using document root <none> and password file <none>
I20260807 22:47:32.937649 14588 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:32.937736 14588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:32.937958 14588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:32.940114 14588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "1cbb1cee69044fedb30c1b03b5e9444e"
format_stamp: "Formatted at 2026-08-07 22:47:32 on dist-test-slave-tm1g"
server_key: "6bbc19379195ec56912fed95812fce31"
server_key_iv: "37cce1e843d20d3486f311599956b112"
server_key_version: "encryptionkey@0"
I20260807 22:47:32.940680 14588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "1cbb1cee69044fedb30c1b03b5e9444e"
format_stamp: "Formatted at 2026-08-07 22:47:32 on dist-test-slave-tm1g"
server_key: "6bbc19379195ec56912fed95812fce31"
server_key_iv: "37cce1e843d20d3486f311599956b112"
server_key_version: "encryptionkey@0"
I20260807 22:47:32.944681 14588 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260807 22:47:32.947032 14603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:32.948203 14588 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:47:32.948335 14588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "1cbb1cee69044fedb30c1b03b5e9444e"
format_stamp: "Formatted at 2026-08-07 22:47:32 on dist-test-slave-tm1g"
server_key: "6bbc19379195ec56912fed95812fce31"
server_key_iv: "37cce1e843d20d3486f311599956b112"
server_key_version: "encryptionkey@0"
I20260807 22:47:32.948450 14588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:32.970496 14588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:32.973541 14588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:32.973743 14588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:32.975322 14588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:32.975399 14588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:32.975471 14588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:32.975505 14588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:47:32 dist-test-slave-tm1g krb5kdc[14469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142852, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:32.987033 14588 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:46709
I20260807 22:47:32.987066 14730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:46709 every 8 connection(s)
I20260807 22:47:32.988197 14588 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:32.990566 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:32.976181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:55033 (local address 127.12.112.254:34309)
0807 22:47:32.976316 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:32.976320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:32.977351 (+ 1031us) server_negotiation.cc:407] Connection header received
0807 22:47:32.978466 (+ 1115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:32.978474 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:32.978559 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:32.978622 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:32.980164 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:32.981077 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:32.982282 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:32.982675 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:32.982788 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:32.986683 (+ 3895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:32.986687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:32.986691 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:32.986726 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:32.988587 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:32.989172 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:32.989175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:32.989177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:32.989263 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:32.989581 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:32.989584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:32.989585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:32.989761 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:32.989838 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:32.990271 (+ 433us) server_negotiation.cc:299] Negotiation successful
0807 22:47:32.990444 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:47:32.991338 14612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:32.976706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34309 (local address 127.12.112.193:55033)
0807 22:47:32.977206 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:32.977249 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:32.978201 (+ 952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:32.979032 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:32.979038 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:32.979417 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:32.979995 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:32.980015 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:32.981213 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:32.981217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:32.982155 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:32.982165 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:32.982848 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:32.982853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:32.983086 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:32.983764 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:32.983787 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:32.986519 (+ 2732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:32.988720 (+ 2201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:32.988726 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:32.988739 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:32.989064 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:32.989350 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:32.989352 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:32.989353 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:32.989503 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:32.989847 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:32.989852 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:32.990064 (+ 212us) client_negotiation.cc:769] Sending connection context
0807 22:47:32.990210 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 22:47:32.990531 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":158,"threads_started":1}
I20260807 22:47:32.992693 14731 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34309
I20260807 22:47:32.992851 14731 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:32.992916 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 14588
I20260807 22:47:32.993036 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:32.993350 12739 external_mini_cluster.cc:1428] Setting key 4196331dbbbfc67cbb05c7bfab05e41b
I20260807 22:47:32.993434 14731 heartbeater.cc:511] Master 127.12.112.254:34309 requested a full tablet report, sending...
I20260807 22:47:32.995256 14514 ts_manager.cc:194] Registered new tserver with Master: 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709)
I20260807 22:47:32.996610 14514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:55033
I20260807 22:47:33.002761 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:32.994860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:43159 (local address 127.12.112.254:34309)
0807 22:47:32.994969 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:32.994975 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:32.995351 (+ 376us) server_negotiation.cc:407] Connection header received
0807 22:47:32.995457 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:32.995461 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:32.995506 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:32.995586 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:32.996141 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:32.996857 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:32.997999 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:32.998384 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:32.998507 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:32.999642 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:32.999645 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:32.999648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:32.999671 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:33.001064 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.001588 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.001590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.001592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.001664 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.001972 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.001974 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.001975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.002129 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:33.002200 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.002560 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.002651 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 22:47:33.002914 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:32.994987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34309 (local address 127.12.112.193:43159)
0807 22:47:32.995254 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:32.995269 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:32.995381 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:32.995621 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:32.995626 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:32.995856 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:32.996014 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:32.996024 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:32.997017 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:32.997020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:32.997835 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:32.997846 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:32.998512 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:32.998515 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:32.998629 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:32.999144 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:32.999164 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:32.999512 (+ 348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:33.001177 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.001184 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.001188 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.001487 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.001756 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.001761 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.001765 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.001877 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.002223 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:33.002228 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:33.002393 (+ 165us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.002511 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.002672 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":3,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:47:33.021231 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34309
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:42111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:33.132043 14741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:33.132334 14741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:33.132413 14741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:33.136380 14741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:33.136466 14741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:33.136533 14741 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 22:47:33.136579 14741 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:47:33.136633 14741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:33.141914 14741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:42111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.112.254:34309
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:33.142988 14741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:33.143991 14741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:33.153468 14746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:33.153462 14749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:33.153462 14747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:33.153837 14741 server_base.cc:1034] running on GCE node
I20260807 22:47:33.154258 14741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:33.154951 14741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:33.156132 14741 hybrid_clock.cc:648] HybridClock initialized: now 1786142853156120 us; error 31 us; skew 500 ppm
Aug 07 22:47:33 dist-test-slave-tm1g krb5kdc[14469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142853, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:33.158942 14741 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:47:33.159802 14741 webserver.cc:460] Webserver started at http://127.12.112.194:40941/ using document root <none> and password file <none>
I20260807 22:47:33.160328 14741 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:33.160387 14741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:33.160548 14741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:33.162614 14741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087"
format_stamp: "Formatted at 2026-08-07 22:47:33 on dist-test-slave-tm1g"
server_key: "a0ca5df2d828a2a70dc3bd8729230a89"
server_key_iv: "afd7cc9997367016376dd2957f5a6346"
server_key_version: "encryptionkey@0"
I20260807 22:47:33.163130 14741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087"
format_stamp: "Formatted at 2026-08-07 22:47:33 on dist-test-slave-tm1g"
server_key: "a0ca5df2d828a2a70dc3bd8729230a89"
server_key_iv: "afd7cc9997367016376dd2957f5a6346"
server_key_version: "encryptionkey@0"
I20260807 22:47:33.166832 14741 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:47:33.169194 14757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:33.170487 14741 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:33.170605 14741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087"
format_stamp: "Formatted at 2026-08-07 22:47:33 on dist-test-slave-tm1g"
server_key: "a0ca5df2d828a2a70dc3bd8729230a89"
server_key_iv: "afd7cc9997367016376dd2957f5a6346"
server_key_version: "encryptionkey@0"
I20260807 22:47:33.170712 14741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:33.188540 14741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:33.191681 14741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:33.191893 14741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:33.193605 14741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:33.193665 14741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:33.193729 14741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:33.193760 14741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:47:33 dist-test-slave-tm1g krb5kdc[14469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142853, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:33.204555 14741 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:34039
I20260807 22:47:33.204615 14874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:34039 every 8 connection(s)
I20260807 22:47:33.205483 14741 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:33.207417 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 14741
I20260807 22:47:33.207548 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:33.207839 12739 external_mini_cluster.cc:1428] Setting key 8ae077d8f202888d27e997ad030920a3
I20260807 22:47:33.208837 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.194436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:60335 (local address 127.12.112.254:34309)
0807 22:47:33.194574 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.194579 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.195462 (+ 883us) server_negotiation.cc:407] Connection header received
0807 22:47:33.196522 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.196527 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.196590 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.196653 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:33.198520 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.199376 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.201262 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.201585 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.201672 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.204854 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:33.204857 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:33.204859 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:33.204885 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:33.206659 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.207247 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.207251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.207253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.207341 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.207709 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.207712 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.207714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.207936 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:33.208031 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.208603 (+ 572us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.208711 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:47:33.209753 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.194840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34309 (local address 127.12.112.194:60335)
0807 22:47:33.195282 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:33.195333 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:33.196257 (+ 924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:33.197093 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:33.197116 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:33.197588 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:33.198302 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.198346 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.199529 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.199534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.201115 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.201128 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.201753 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.201759 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.201995 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.202769 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:33.202794 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:33.204675 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:33.206771 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.206778 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.206795 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.207109 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.207430 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.207435 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.207437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.207620 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.208031 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:33.208039 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:33.208354 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.208558 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.208871 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":132,"threads_started":1}
I20260807 22:47:33.211114 14875 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34309
I20260807 22:47:33.211252 14875 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:33.211808 14875 heartbeater.cc:511] Master 127.12.112.254:34309 requested a full tablet report, sending...
I20260807 22:47:33.212888 14514 ts_manager.cc:194] Registered new tserver with Master: e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194:34039)
I20260807 22:47:33.213608 14514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:60335
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:47:33.224936 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.213443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:44677 (local address 127.12.112.254:34309)
0807 22:47:33.213540 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.213544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.218126 (+ 4582us) server_negotiation.cc:407] Connection header received
0807 22:47:33.218201 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.218203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.218242 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.218368 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:33.218779 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.219356 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.220142 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.220449 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.220542 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.221708 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:33.221714 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:33.221720 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:33.221752 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:33.223242 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.223702 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.223705 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.223706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.223779 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.224081 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.224083 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.224084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.224281 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:33.224359 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.224708 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.224821 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 22:47:33.225073 14882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.213375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34309 (local address 127.12.112.194:44677)
0807 22:47:33.218023 (+ 4648us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:33.218040 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:33.218139 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:33.218388 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:33.218391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:33.218556 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:33.218650 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.218655 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.219468 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.219471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.220035 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.220043 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.220579 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.220586 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.220723 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.221241 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:33.221252 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:33.221566 (+ 314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:33.223331 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.223335 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.223337 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.223609 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.223873 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.223879 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.223884 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.223989 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.224379 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:33.224385 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:33.224508 (+ 123us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.224633 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.224796 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4534,"thread_start_us":118,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:47:33.235512 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34309
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:42111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:33.346858 14884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:33.347124 14884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:33.347199 14884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:33.351123 14884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:33.351191 14884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:33.351279 14884 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 22:47:33.351322 14884 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:47:33.351364 14884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:33.356604 14884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:42111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.112.254:34309
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:33.357509 14884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:33.358489 14884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:33.368001 14889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:33.367990 14890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:33.367990 14892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:33.368098 14884 server_base.cc:1034] running on GCE node
I20260807 22:47:33.368690 14884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:33.369306 14884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:33.370509 14884 hybrid_clock.cc:648] HybridClock initialized: now 1786142853370476 us; error 42 us; skew 500 ppm
Aug 07 22:47:33 dist-test-slave-tm1g krb5kdc[14469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142853, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:33.373235 14884 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:47:33.374150 14884 webserver.cc:460] Webserver started at http://127.12.112.195:46223/ using document root <none> and password file <none>
I20260807 22:47:33.374854 14884 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:33.374951 14884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:33.375164 14884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:33.377223 14884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "343259e98ef249938ff56c20ef8c7232"
format_stamp: "Formatted at 2026-08-07 22:47:33 on dist-test-slave-tm1g"
server_key: "b34477319a93dad2ad8f961e41d347f5"
server_key_iv: "0d9f74817e7aead85f6f1eab47c1a7da"
server_key_version: "encryptionkey@0"
I20260807 22:47:33.377805 14884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "343259e98ef249938ff56c20ef8c7232"
format_stamp: "Formatted at 2026-08-07 22:47:33 on dist-test-slave-tm1g"
server_key: "b34477319a93dad2ad8f961e41d347f5"
server_key_iv: "0d9f74817e7aead85f6f1eab47c1a7da"
server_key_version: "encryptionkey@0"
I20260807 22:47:33.382432 14884 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260807 22:47:33.384761 14899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:33.385955 14884 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:33.386096 14884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "343259e98ef249938ff56c20ef8c7232"
format_stamp: "Formatted at 2026-08-07 22:47:33 on dist-test-slave-tm1g"
server_key: "b34477319a93dad2ad8f961e41d347f5"
server_key_iv: "0d9f74817e7aead85f6f1eab47c1a7da"
server_key_version: "encryptionkey@0"
I20260807 22:47:33.386207 14884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:33.414849 14884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:33.418152 14884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:33.418383 14884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:33.419821 14884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:33.419893 14884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:33.419967 14884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:33.420008 14884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:47:33 dist-test-slave-tm1g krb5kdc[14469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142853, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:33.431337 14884 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:42247
I20260807 22:47:33.431398 15017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:42247 every 8 connection(s)
I20260807 22:47:33.432415 14884 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:47:33.433842 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.420672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:32775 (local address 127.12.112.254:34309)
0807 22:47:33.420796 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.420799 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.421883 (+ 1084us) server_negotiation.cc:407] Connection header received
0807 22:47:33.422966 (+ 1083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.422972 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.423039 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.423105 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:33.424524 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.425469 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.426781 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.427047 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.427170 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.429937 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:33.429940 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:33.429943 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:33.429975 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:33.431660 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.432194 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.432198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.432200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.432296 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.432650 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.432653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.432655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.432930 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:33.433034 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.433621 (+ 587us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.433723 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:47:33.434711 14909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.421201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34309 (local address 127.12.112.195:32775)
0807 22:47:33.421711 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:33.421769 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:33.422703 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:33.423522 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:33.423528 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:33.423890 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:33.424364 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.424376 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.425605 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.425609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.426654 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.426663 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.427218 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.427222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.427389 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.428017 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:33.428043 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:33.429763 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:33.431765 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.431770 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.431779 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.432090 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.432387 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.432390 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.432392 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.432571 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.433093 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:33.433101 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:33.433382 (+ 281us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.433557 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.433802 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":149,"threads_started":1}
I20260807 22:47:33.436029 15018 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34309
I20260807 22:47:33.436187 15018 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:33.436728 15018 heartbeater.cc:511] Master 127.12.112.254:34309 requested a full tablet report, sending...
I20260807 22:47:33.437721 14512 ts_manager.cc:194] Registered new tserver with Master: 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247)
I20260807 22:47:33.438531 14512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:32775
I20260807 22:47:33.442219 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 14884
I20260807 22:47:33.442373 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:47:33.442744 12739 external_mini_cluster.cc:1428] Setting key 996e5d1bb0b9f0f887a5bc346bf96ddf
I20260807 22:47:33.444753 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:47:33.445235 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.438092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:56103 (local address 127.12.112.254:34309)
0807 22:47:33.438222 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.438226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.438449 (+ 223us) server_negotiation.cc:407] Connection header received
0807 22:47:33.438562 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.438564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.438600 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.438689 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:33.439102 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.439596 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.440443 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.440685 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.440785 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.441879 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:33.441882 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:33.441884 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:33.441904 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:33.443503 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.444027 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.444029 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.444030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.444102 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.444379 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.444384 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.444386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.444615 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:33.444719 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.444992 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.445100 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:47:33.445250 15024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.438041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34309 (local address 127.12.112.195:56103)
0807 22:47:33.438369 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:33.438383 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:33.438481 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:33.438705 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:33.438708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:33.438896 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:33.438990 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.438995 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.439713 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.439716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.440334 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.440342 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.440798 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.440801 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.440893 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.441408 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:33.441425 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:33.441745 (+ 320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:33.443620 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.443622 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.443624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.443808 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.444203 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.444206 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.444208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.444293 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.444719 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:33.444722 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:33.444817 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.444930 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.445072 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":124,"threads_started":1}
Aug 07 22:47:33 dist-test-slave-tm1g krb5kdc[14469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:47:33 dist-test-slave-tm1g krb5kdc[14469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:33.471338 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.463482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54090 (local address 127.12.112.254:34309)
0807 22:47:33.463607 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.463611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.463622 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:47:33.463662 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.463665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.463704 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.463767 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:33.464476 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.465005 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.465859 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.466068 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.466140 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.468422 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:33.468426 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:33.468428 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:33.468451 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:33.469806 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.470173 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.470175 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.470177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.470247 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.470533 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.470535 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.470536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.470698 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:33.470799 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.471044 (+ 245us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.471133 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:47:33.474393 14512 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:47:33.477430 14512 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:33.491977 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.485609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:34039 (local address 127.0.0.1:54290)
0807 22:47:33.486401 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:33.486451 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:33.486622 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:33.487520 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:33.487523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:33.487541 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:33.487661 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.487667 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.489088 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.489091 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.490392 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.490403 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.491337 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.491341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.491447 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.491493 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.491601 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.491799 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":67,"spinlock_wait_cycles":3328,"thread_start_us":89,"threads_started":1}
I20260807 22:47:33.492041 15037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.485735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54290 (local address 127.12.112.194:34039)
0807 22:47:33.487115 (+ 1380us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.487125 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.487144 (+ 19us) server_negotiation.cc:407] Connection header received
0807 22:47:33.487208 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.487213 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.487397 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.487538 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:33.487775 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.488963 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.490515 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.491214 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.491367 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.491499 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.491761 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.491873 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1282,"thread_start_us":107,"threads_started":1}
I20260807 22:47:33.491977 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.485698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:46709 (local address 127.0.0.1:49150)
0807 22:47:33.486402 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:33.486452 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:33.486623 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:33.487396 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:33.487402 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:33.487426 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:33.487576 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.487583 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.489151 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.489153 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.490359 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.490369 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.491433 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.491437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.491523 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.491545 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.491597 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.491805 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"mutex_wait_us":33,"spinlock_wait_cycles":7296,"thread_start_us":109,"threads_started":1}
I20260807 22:47:33.492575 15040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.486428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37532 (local address 127.12.112.195:42247)
0807 22:47:33.486898 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.486912 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.487116 (+ 204us) server_negotiation.cc:407] Connection header received
0807 22:47:33.487336 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.487341 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.487534 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.487656 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:33.488022 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.488765 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.490470 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.491277 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.491430 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.491553 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.492333 (+ 780us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.492435 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":151,"threads_started":1}
I20260807 22:47:33.492969 15036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.485988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:42247 (local address 127.0.0.1:37532)
0807 22:47:33.487021 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:33.487034 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:33.487181 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:33.487828 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:33.487830 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:33.487844 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:33.487915 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.487919 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.488877 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.488882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.490348 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.490360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.491579 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.491584 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.491914 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.491938 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.492755 (+ 817us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.492832 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":962,"mutex_wait_us":216,"thread_start_us":97,"threads_started":1}
I20260807 22:47:33.493134 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.486462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49150 (local address 127.12.112.193:46709)
0807 22:47:33.486900 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.486914 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.486937 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:47:33.487017 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.487022 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.487221 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.487738 (+ 517us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:33.487885 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.488989 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.490515 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.491277 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.492732 (+ 1455us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.492852 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.492902 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.492990 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":97,"threads_started":1}
I20260807 22:47:33.495421 14657 tablet_service.cc:1467] Processing CreateTablet for tablet a2610a3bb0aa4946ab63a9b653d9a6df (DEFAULT_TABLE table=test-table [id=2ccaf9714d86450b998b0d17aec77603]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:33.495234 14807 tablet_service.cc:1467] Processing CreateTablet for tablet a2610a3bb0aa4946ab63a9b653d9a6df (DEFAULT_TABLE table=test-table [id=2ccaf9714d86450b998b0d17aec77603]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:33.495844 14950 tablet_service.cc:1467] Processing CreateTablet for tablet a2610a3bb0aa4946ab63a9b653d9a6df (DEFAULT_TABLE table=test-table [id=2ccaf9714d86450b998b0d17aec77603]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:33.496361 14807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2610a3bb0aa4946ab63a9b653d9a6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:33.496368 14657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2610a3bb0aa4946ab63a9b653d9a6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:33.496754 14950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2610a3bb0aa4946ab63a9b653d9a6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:33.503019 15041 tablet_bootstrap.cc:492] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: Bootstrap starting.
I20260807 22:47:33.504433 15042 tablet_bootstrap.cc:492] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: Bootstrap starting.
I20260807 22:47:33.504433 15043 tablet_bootstrap.cc:492] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: Bootstrap starting.
I20260807 22:47:33.505321 15041 tablet_bootstrap.cc:654] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:33.506510 15043 tablet_bootstrap.cc:654] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:33.506510 15042 tablet_bootstrap.cc:654] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:33.506531 15041 log.cc:824] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:33.507335 15042 log.cc:824] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:33.507335 15043 log.cc:824] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:33.508653 15041 tablet_bootstrap.cc:492] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: No bootstrap required, opened a new log
I20260807 22:47:33.508858 15041 ts_tablet_manager.cc:1397] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260807 22:47:33.509182 15042 tablet_bootstrap.cc:492] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: No bootstrap required, opened a new log
I20260807 22:47:33.509366 15042 ts_tablet_manager.cc:1397] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 22:47:33.509392 15043 tablet_bootstrap.cc:492] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: No bootstrap required, opened a new log
I20260807 22:47:33.509546 15043 ts_tablet_manager.cc:1397] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 22:47:33.512504 15042 raft_consensus.cc:348] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.512746 15042 raft_consensus.cc:374] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:33.512806 15042 raft_consensus.cc:729] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 343259e98ef249938ff56c20ef8c7232, State: Initialized, Role: FOLLOWER
I20260807 22:47:33.512717 15041 raft_consensus.cc:348] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.512972 15041 raft_consensus.cc:374] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:33.513032 15041 raft_consensus.cc:729] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbb1cee69044fedb30c1b03b5e9444e, State: Initialized, Role: FOLLOWER
I20260807 22:47:33.513280 15042 consensus_queue.cc:260] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.513221 15043 raft_consensus.cc:348] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.513438 15043 raft_consensus.cc:374] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:33.513491 15043 raft_consensus.cc:729] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c5f4dc5d0e40edbabd7d95e9e95087, State: Initialized, Role: FOLLOWER
I20260807 22:47:33.513425 15041 consensus_queue.cc:260] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.513917 15018 heartbeater.cc:503] Master 127.12.112.254:34309 was elected leader, sending a full tablet report...
I20260807 22:47:33.513896 15043 consensus_queue.cc:260] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.514268 15042 ts_tablet_manager.cc:1428] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:47:33.514343 15041 ts_tablet_manager.cc:1428] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260807 22:47:33.514644 14731 heartbeater.cc:503] Master 127.12.112.254:34309 was elected leader, sending a full tablet report...
I20260807 22:47:33.514752 15043 ts_tablet_manager.cc:1428] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 22:47:33.515064 14875 heartbeater.cc:503] Master 127.12.112.254:34309 was elected leader, sending a full tablet report...
W20260807 22:47:33.683436 15019 tablet.cc:2369] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:47:33.706835 14876 tablet.cc:2369] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:47:33.720764 15047 raft_consensus.cc:482] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:33.720971 15047 raft_consensus.cc:504] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.722194 15047 leader_election.cc:288] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194:34039), 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709)
I20260807 22:47:33.726907 14909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.722507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:34039 (local address 127.12.112.195:54367)
0807 22:47:33.722714 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:33.722729 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:33.722840 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:33.723132 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:33.723136 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:33.723165 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:33.723322 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.723330 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.724478 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.724482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.725615 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.725627 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.726460 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.726464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.726582 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.726609 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.726683 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.726758 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":30}
I20260807 22:47:33.726909 15037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.722566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:54367 (local address 127.12.112.194:34039)
0807 22:47:33.722682 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.722686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.722800 (+ 114us) server_negotiation.cc:407] Connection header received
0807 22:47:33.722955 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.722958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.723005 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.723090 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:33.723454 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.724357 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.725744 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.726357 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.726469 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.726525 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.726717 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.726790 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:47:33.727610 14828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2610a3bb0aa4946ab63a9b653d9a6df" candidate_uuid: "343259e98ef249938ff56c20ef8c7232" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" is_pre_election: true
I20260807 22:47:33.727777 15050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.722780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:46709 (local address 127.12.112.195:49547)
0807 22:47:33.723132 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:33.723146 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:33.723238 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:33.723486 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:33.723490 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:33.723508 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:33.724120 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.724131 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.725153 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.725156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.726231 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.726240 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.727336 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.727340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.727450 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.727473 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.727551 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.727616 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":41,"thread_start_us":130,"threads_started":1}
I20260807 22:47:33.727809 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.722549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:49547 (local address 127.12.112.193:46709)
0807 22:47:33.722685 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.722690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.723217 (+ 527us) server_negotiation.cc:407] Connection header received
0807 22:47:33.723340 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.723343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.723390 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.723455 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:33.724250 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.725032 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.726394 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.727094 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.727218 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.727269 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.727599 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.727676 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:47:33.727941 14828 raft_consensus.cc:2454] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 343259e98ef249938ff56c20ef8c7232 in term 0.
I20260807 22:47:33.728498 14904 leader_election.cc:302] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 343259e98ef249938ff56c20ef8c7232, e5c5f4dc5d0e40edbabd7d95e9e95087; no voters:
I20260807 22:47:33.728556 14683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2610a3bb0aa4946ab63a9b653d9a6df" candidate_uuid: "343259e98ef249938ff56c20ef8c7232" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" is_pre_election: true
I20260807 22:47:33.728799 14683 raft_consensus.cc:2454] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 343259e98ef249938ff56c20ef8c7232 in term 0.
I20260807 22:47:33.728811 15047 raft_consensus.cc:2781] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:33.728919 15047 raft_consensus.cc:482] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:33.728986 15047 raft_consensus.cc:3037] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:33.730119 15047 raft_consensus.cc:504] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.730581 15047 leader_election.cc:288] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [CANDIDATE]: Term 1 election: Requested vote from peers e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194:34039), 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709)
I20260807 22:47:33.730906 14828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2610a3bb0aa4946ab63a9b653d9a6df" candidate_uuid: "343259e98ef249938ff56c20ef8c7232" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087"
I20260807 22:47:33.730963 14683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2610a3bb0aa4946ab63a9b653d9a6df" candidate_uuid: "343259e98ef249938ff56c20ef8c7232" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbb1cee69044fedb30c1b03b5e9444e"
I20260807 22:47:33.731033 14828 raft_consensus.cc:3037] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:33.731066 14683 raft_consensus.cc:3037] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:33.732282 14828 raft_consensus.cc:2454] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 343259e98ef249938ff56c20ef8c7232 in term 1.
I20260807 22:47:33.732282 14683 raft_consensus.cc:2454] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 343259e98ef249938ff56c20ef8c7232 in term 1.
I20260807 22:47:33.732602 14901 leader_election.cc:302] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbb1cee69044fedb30c1b03b5e9444e, 343259e98ef249938ff56c20ef8c7232; no voters:
I20260807 22:47:33.732795 15047 raft_consensus.cc:2781] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:33.733009 15047 raft_consensus.cc:686] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 1 LEADER]: Becoming Leader. State: Replica: 343259e98ef249938ff56c20ef8c7232, State: Running, Role: LEADER
I20260807 22:47:33.733335 15047 consensus_queue.cc:237] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.736488 14514 catalog_manager.cc:5495] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 reported cstate change: term changed from 0 to 1, leader changed from <none> to 343259e98ef249938ff56c20ef8c7232 (127.12.112.195). New cstate: current_term: 1 leader_uuid: "343259e98ef249938ff56c20ef8c7232" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } health_report { overall_health: HEALTHY } } }
W20260807 22:47:33.739540 14732 tablet.cc:2369] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 22:47:33 dist-test-slave-tm1g krb5kdc[14469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142852, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:33.812697 15058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.804128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34309 (local address 127.0.0.1:54092)
0807 22:47:33.804432 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:33.804444 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:33.804575 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:33.804832 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:33.804835 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:33.805270 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:33.805368 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.805374 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.806114 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.806119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.806746 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:33.806755 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.807182 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.807185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:33.807320 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.807894 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:33.807906 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:33.809333 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:33.811036 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.811044 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.811049 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.811359 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.811620 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:33.811622 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:33.811623 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:33.811705 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:33.812115 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:33.812121 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:33.812226 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 22:47:33.812349 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 22:47:33.812520 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":32,"thread_start_us":111,"threads_started":1}
I20260807 22:47:33.812704 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:33.804168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54092 (local address 127.12.112.254:34309)
0807 22:47:33.804334 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:33.804339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:33.804516 (+ 177us) server_negotiation.cc:407] Connection header received
0807 22:47:33.804676 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:33.804679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:33.804722 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:33.804801 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:33.805481 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.806009 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.806867 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:33.807077 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:33.807177 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:33.809486 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:33.809489 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:33.809491 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:33.809514 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:33.810915 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.811465 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.811467 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.811468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.811544 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:33.811827 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:33.811830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:33.811832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:33.812016 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:33.812102 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:33.812397 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 22:47:33.812577 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":44}
I20260807 22:47:33.816612 14514 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:54092:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 22:47:33.817378 14514 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:33.822108 14657 tablet_service.cc:1467] Processing CreateTablet for tablet bcda924bf2134774b7ec46412a553d6d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0220f341845043778d49e970b82d6029]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:47:33.822095 14807 tablet_service.cc:1467] Processing CreateTablet for tablet bcda924bf2134774b7ec46412a553d6d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0220f341845043778d49e970b82d6029]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:47:33.822284 14950 tablet_service.cc:1467] Processing CreateTablet for tablet bcda924bf2134774b7ec46412a553d6d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0220f341845043778d49e970b82d6029]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:47:33.822863 14657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcda924bf2134774b7ec46412a553d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:33.822868 14807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcda924bf2134774b7ec46412a553d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:33.822867 14950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcda924bf2134774b7ec46412a553d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:33.825338 15041 tablet_bootstrap.cc:492] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: Bootstrap starting.
I20260807 22:47:33.825783 15043 tablet_bootstrap.cc:492] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: Bootstrap starting.
I20260807 22:47:33.826102 15042 tablet_bootstrap.cc:492] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: Bootstrap starting.
I20260807 22:47:33.826447 15041 tablet_bootstrap.cc:654] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:33.826838 15043 tablet_bootstrap.cc:654] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:33.827072 15042 tablet_bootstrap.cc:654] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:33.828007 15041 tablet_bootstrap.cc:492] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: No bootstrap required, opened a new log
I20260807 22:47:33.828006 15043 tablet_bootstrap.cc:492] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: No bootstrap required, opened a new log
I20260807 22:47:33.828096 15041 ts_tablet_manager.cc:1397] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 22:47:33.828096 15043 ts_tablet_manager.cc:1397] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:33.828327 15042 tablet_bootstrap.cc:492] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: No bootstrap required, opened a new log
I20260807 22:47:33.828414 15042 ts_tablet_manager.cc:1397] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:33.828547 15043 raft_consensus.cc:348] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.828547 15041 raft_consensus.cc:348] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.828672 15041 raft_consensus.cc:374] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:33.828672 15043 raft_consensus.cc:374] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:33.828717 15043 raft_consensus.cc:729] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c5f4dc5d0e40edbabd7d95e9e95087, State: Initialized, Role: FOLLOWER
I20260807 22:47:33.828717 15041 raft_consensus.cc:729] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbb1cee69044fedb30c1b03b5e9444e, State: Initialized, Role: FOLLOWER
I20260807 22:47:33.828853 15043 consensus_queue.cc:260] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.828853 15041 consensus_queue.cc:260] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.828857 15042 raft_consensus.cc:348] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.828989 15042 raft_consensus.cc:374] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:33.829022 15042 raft_consensus.cc:729] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 343259e98ef249938ff56c20ef8c7232, State: Initialized, Role: FOLLOWER
I20260807 22:47:33.829119 15041 ts_tablet_manager.cc:1428] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:47:33.829118 15043 ts_tablet_manager.cc:1428] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:47:33.829142 15042 consensus_queue.cc:260] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:33.829124 15049 tablet_replica.cc:439] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } } }
I20260807 22:47:33.829381 15049 tablet_replica.cc:442] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:33.829425 15042 ts_tablet_manager.cc:1428] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:47:33.829380 15047 tablet_replica.cc:439] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } } }
I20260807 22:47:33.829490 15047 tablet_replica.cc:442] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:33.829847 15048 tablet_replica.cc:439] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } } }
I20260807 22:47:33.829974 15048 tablet_replica.cc:442] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:34.246119 15049 raft_consensus.cc:482] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:34.246274 15049 raft_consensus.cc:504] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.247469 15049 leader_election.cc:288] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709), 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247)
I20260807 22:47:34.251720 15063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.247824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:55309 (local address 127.12.112.193:46709)
0807 22:47:34.248105 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:34.248111 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:34.248274 (+ 163us) server_negotiation.cc:407] Connection header received
0807 22:47:34.248437 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:34.248443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:34.248506 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:34.248595 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:34.248895 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.249509 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.250690 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.251123 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.251254 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.251340 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:34.251485 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 22:47:34.251573 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":74,"threads_started":1}
I20260807 22:47:34.251726 15062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.247743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:46709 (local address 127.12.112.194:55309)
0807 22:47:34.248169 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:34.248186 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:34.248322 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:34.248617 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:34.248620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:34.248639 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:34.248767 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.248786 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.249621 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.249627 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.250565 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.250575 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.251236 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.251241 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.251337 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.251363 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:47:34.251457 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:47:34.251514 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":52,"thread_start_us":74,"threads_started":1}
I20260807 22:47:34.251775 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.247750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:42247 (local address 127.12.112.194:56799)
0807 22:47:34.248394 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:34.248408 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:34.248517 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:34.248791 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:34.248794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:34.248810 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:34.248934 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.248943 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.249697 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.249699 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.250585 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.250594 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.251350 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.251357 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.251478 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.251504 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:47:34.251579 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 22:47:34.251641 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":284,"thread_start_us":62,"threads_started":1}
I20260807 22:47:34.251830 15064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.247872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:56799 (local address 127.12.112.195:42247)
0807 22:47:34.248141 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:34.248155 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:34.248500 (+ 345us) server_negotiation.cc:407] Connection header received
0807 22:47:34.248631 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:34.248634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:34.248681 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:34.248770 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:34.249045 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.249579 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.250726 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.251219 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.251336 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.251388 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:34.251609 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 22:47:34.251690 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":88,"threads_started":1}
I20260807 22:47:34.252401 14683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcda924bf2134774b7ec46412a553d6d" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" is_pre_election: true
I20260807 22:47:34.252559 14683 raft_consensus.cc:2454] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 0.
I20260807 22:47:34.252547 14971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcda924bf2134774b7ec46412a553d6d" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "343259e98ef249938ff56c20ef8c7232" is_pre_election: true
I20260807 22:47:34.252787 14971 raft_consensus.cc:2454] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 0.
I20260807 22:47:34.252943 14759 leader_election.cc:302] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbb1cee69044fedb30c1b03b5e9444e, e5c5f4dc5d0e40edbabd7d95e9e95087; no voters:
I20260807 22:47:34.253232 15049 raft_consensus.cc:2781] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:34.253298 15049 raft_consensus.cc:482] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:34.253340 15049 raft_consensus.cc:3037] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:34.254391 15049 raft_consensus.cc:504] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.254741 15049 leader_election.cc:288] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 election: Requested vote from peers 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709), 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247)
I20260807 22:47:34.255033 14683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcda924bf2134774b7ec46412a553d6d" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbb1cee69044fedb30c1b03b5e9444e"
I20260807 22:47:34.255071 14971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcda924bf2134774b7ec46412a553d6d" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "343259e98ef249938ff56c20ef8c7232"
I20260807 22:47:34.255255 14971 raft_consensus.cc:3037] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:34.255302 14683 raft_consensus.cc:3037] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:34.256214 14971 raft_consensus.cc:2454] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 1.
I20260807 22:47:34.256239 14683 raft_consensus.cc:2454] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 1.
I20260807 22:47:34.256512 14760 leader_election.cc:302] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 343259e98ef249938ff56c20ef8c7232, e5c5f4dc5d0e40edbabd7d95e9e95087; no voters:
I20260807 22:47:34.256682 15049 raft_consensus.cc:2781] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:34.256860 15049 raft_consensus.cc:686] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 LEADER]: Becoming Leader. State: Replica: e5c5f4dc5d0e40edbabd7d95e9e95087, State: Running, Role: LEADER
I20260807 22:47:34.257205 15049 consensus_queue.cc:237] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.259490 15066 tablet_replica.cc:439] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: TxnStatusTablet state changed. Reason: New leader e5c5f4dc5d0e40edbabd7d95e9e95087. Latest consensus state: current_term: 1 leader_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } } }
I20260807 22:47:34.259613 15066 tablet_replica.cc:442] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:47:34.259980 15068 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 22:47:34.260182 15068 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 22:47:34.260546 14513 catalog_manager.cc:5495] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194). New cstate: current_term: 1 leader_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } health_report { overall_health: UNKNOWN } } }
I20260807 22:47:34.283795 15071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.279514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54292 (local address 127.12.112.194:34039)
0807 22:47:34.279793 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:34.279800 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:34.279813 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:47:34.279882 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:34.279884 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:34.279946 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:34.280040 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:34.280323 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.280965 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.282252 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.282579 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.282666 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.282998 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:34.283405 (+ 407us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:34.283501 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:34.283609 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 22:47:34.283661 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":132,"threads_started":1}
I20260807 22:47:34.283859 15058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.279389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:34039 (local address 127.0.0.1:54292)
0807 22:47:34.279587 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:34.279603 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:34.279709 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:34.280087 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:34.280090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:34.280098 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:47:34.280213 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.280220 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.281081 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.281084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.282096 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.282114 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.282687 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.282691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.282786 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.282855 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:47:34.283505 (+ 650us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:47:34.283521 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 22:47:34.283597 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:47:34.283689 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 22:47:34.289124 14683 raft_consensus.cc:1261] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Refusing update from remote peer e5c5f4dc5d0e40edbabd7d95e9e95087: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:34.289121 14971 raft_consensus.cc:1261] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Refusing update from remote peer e5c5f4dc5d0e40edbabd7d95e9e95087: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:34.289793 15066 consensus_queue.cc:1035] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:34.290011 15049 consensus_queue.cc:1035] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:34.293375 15047 tablet_replica.cc:439] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: TxnStatusTablet state changed. Reason: New leader e5c5f4dc5d0e40edbabd7d95e9e95087. Latest consensus state: current_term: 1 leader_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } } }
I20260807 22:47:34.293501 15047 tablet_replica.cc:442] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:34.293998 15048 tablet_replica.cc:439] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: TxnStatusTablet state changed. Reason: New leader e5c5f4dc5d0e40edbabd7d95e9e95087. Latest consensus state: current_term: 1 leader_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } } }
I20260807 22:47:34.294111 15048 tablet_replica.cc:442] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:34.296644 15066 tablet_replica.cc:439] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } } }
I20260807 22:47:34.296782 15066 tablet_replica.cc:442] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:47:34.296904 15066 tablet_replica.cc:439] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } } }
I20260807 22:47:34.296991 15066 tablet_replica.cc:442] T bcda924bf2134774b7ec46412a553d6d P e5c5f4dc5d0e40edbabd7d95e9e95087: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:47:34.298095 15048 tablet_replica.cc:439] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } } }
I20260807 22:47:34.298216 15048 tablet_replica.cc:442] T bcda924bf2134774b7ec46412a553d6d P 1cbb1cee69044fedb30c1b03b5e9444e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:34.298935 15047 tablet_replica.cc:439] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } } }
I20260807 22:47:34.299046 15047 tablet_replica.cc:442] T bcda924bf2134774b7ec46412a553d6d P 343259e98ef249938ff56c20ef8c7232: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:47:34.300787 15074 mvcc.cc:205] Tried to move back new op lower bound from 7316041131161255936 to 7316041131040014336. Current Snapshot: MvccSnapshot[applied={T|T < 7316041131161255936}]
I20260807 22:47:34.307736 15064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.303689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37546 (local address 127.12.112.195:42247)
0807 22:47:34.303812 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:34.303824 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:34.304016 (+ 192us) server_negotiation.cc:407] Connection header received
0807 22:47:34.304140 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:34.304144 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:34.304229 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:34.304342 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:34.304578 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.305378 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.306212 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.306587 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.306693 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.306917 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:34.307389 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:34.307493 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:34.307551 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 22:47:34.307607 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:47:34.315758 15047 consensus_queue.cc:1035] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:34.319025 15071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.314594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:36743 (local address 127.12.112.194:34039)
0807 22:47:34.314712 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:34.314716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:34.314949 (+ 233us) server_negotiation.cc:407] Connection header received
0807 22:47:34.315086 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:34.315089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:34.315140 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:34.315216 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:34.315485 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.316278 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.317658 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.318021 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.318099 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.318569 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:34.318647 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:34.318690 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:34.318844 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 22:47:34.318895 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:47:34.319373 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.314501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:34039 (local address 127.12.112.195:36743)
0807 22:47:34.314850 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:34.314861 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:34.314990 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:34.315241 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:34.315244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:34.315251 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:47:34.315363 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.315369 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.316411 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.316415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.317509 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.317521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.318207 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.318210 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.318334 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.318383 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:47:34.318751 (+ 368us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:47:34.318756 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:47:34.319148 (+ 392us) client_negotiation.cc:240] Negotiation successful
0807 22:47:34.319228 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":101,"threads_started":1}
I20260807 22:47:34.321507 15047 consensus_queue.cc:1035] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:34.348388 15064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.344619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:50543 (local address 127.12.112.195:42247)
0807 22:47:34.344738 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:34.344744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:34.344883 (+ 139us) server_negotiation.cc:407] Connection header received
0807 22:47:34.345048 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:34.345051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:34.345101 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:34.345175 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:34.345464 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.345988 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.347154 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.347516 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.347614 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.347986 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:34.348057 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:34.348117 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:34.348232 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 22:47:34.348281 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:47:34.348683 15094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.344280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:42247 (local address 127.12.112.194:50543)
0807 22:47:34.344809 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:34.344824 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:34.344933 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:34.345196 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:34.345198 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:34.345206 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:47:34.345349 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.345354 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.346096 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.346101 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.347038 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.347048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.347698 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.347702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.347798 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.347847 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:47:34.348140 (+ 293us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:47:34.348146 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:47:34.348214 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 22:47:34.348292 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":94,"threads_started":1}
I20260807 22:47:34.376125 14513 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:34.376340 14513 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:34.379170 14513 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82: Sending DeleteTablet for 3 replicas of tablet a2610a3bb0aa4946ab63a9b653d9a6df
I20260807 22:47:34.380110 14657 tablet_service.cc:1514] Processing DeleteTablet for tablet a2610a3bb0aa4946ab63a9b653d9a6df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:34 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:49150
I20260807 22:47:34.380163 14950 tablet_service.cc:1514] Processing DeleteTablet for tablet a2610a3bb0aa4946ab63a9b653d9a6df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:34 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:37532
I20260807 22:47:34.380617 15098 tablet_replica.cc:330] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: stopping tablet replica
I20260807 22:47:34.380862 14807 tablet_service.cc:1514] Processing DeleteTablet for tablet a2610a3bb0aa4946ab63a9b653d9a6df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:34 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:54290
I20260807 22:47:34.380951 15098 raft_consensus.cc:2229] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:34.381160 15098 raft_consensus.cc:2258] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:34.382117 14513 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:47:34.382701 14513 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:34.384500 15099 tablet_replica.cc:330] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: stopping tablet replica
I20260807 22:47:34.384766 15100 tablet_replica.cc:330] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: stopping tablet replica
I20260807 22:47:34.385146 15100 raft_consensus.cc:2229] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:34.385486 15099 raft_consensus.cc:2229] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:47:34.385708 15100 raft_consensus.cc:2258] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:34.386089 15099 raft_consensus.cc:2258] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:34.387576 15100 ts_tablet_manager.cc:1905] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:34.388839 15099 ts_tablet_manager.cc:1905] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:34.389647 14807 tablet_service.cc:1467] Processing CreateTablet for tablet 011f7dea800644989c1cba3acee4f792 (DEFAULT_TABLE table=test-table [id=78937edbbbab437da10b000e3e71a634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:34.389755 14657 tablet_service.cc:1467] Processing CreateTablet for tablet 011f7dea800644989c1cba3acee4f792 (DEFAULT_TABLE table=test-table [id=78937edbbbab437da10b000e3e71a634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:34.390048 14657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 011f7dea800644989c1cba3acee4f792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:34.390483 14807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 011f7dea800644989c1cba3acee4f792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:34.390938 14950 tablet_service.cc:1467] Processing CreateTablet for tablet 011f7dea800644989c1cba3acee4f792 (DEFAULT_TABLE table=test-table [id=78937edbbbab437da10b000e3e71a634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:34.394556 14950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 011f7dea800644989c1cba3acee4f792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:34.397222 15100 ts_tablet_manager.cc:1918] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:47:34.398518 15102 tablet_bootstrap.cc:492] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e: Bootstrap starting.
I20260807 22:47:34.398659 15098 ts_tablet_manager.cc:1905] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:34.399114 15099 ts_tablet_manager.cc:1918] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:47:34.399281 15100 log.cc:1196] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/a2610a3bb0aa4946ab63a9b653d9a6df
I20260807 22:47:34.399535 15102 tablet_bootstrap.cc:654] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:34.399693 15099 log.cc:1196] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/a2610a3bb0aa4946ab63a9b653d9a6df
I20260807 22:47:34.400027 15100 ts_tablet_manager.cc:1939] T a2610a3bb0aa4946ab63a9b653d9a6df P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting consensus metadata
I20260807 22:47:34.400442 15099 ts_tablet_manager.cc:1939] T a2610a3bb0aa4946ab63a9b653d9a6df P 343259e98ef249938ff56c20ef8c7232: Deleting consensus metadata
I20260807 22:47:34.401927 14501 catalog_manager.cc:4841] TS e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194:34039): tablet a2610a3bb0aa4946ab63a9b653d9a6df (table test-table [id=2ccaf9714d86450b998b0d17aec77603]) successfully deleted
I20260807 22:47:34.400689 15101 tablet_bootstrap.cc:492] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087: Bootstrap starting.
I20260807 22:47:34.402283 15098 ts_tablet_manager.cc:1918] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:47:34.402418 15098 log.cc:1196] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/a2610a3bb0aa4946ab63a9b653d9a6df
I20260807 22:47:34.402740 15098 ts_tablet_manager.cc:1939] T a2610a3bb0aa4946ab63a9b653d9a6df P 1cbb1cee69044fedb30c1b03b5e9444e: Deleting consensus metadata
I20260807 22:47:34.404065 15101 tablet_bootstrap.cc:654] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:34.404620 14499 catalog_manager.cc:4841] TS 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709): tablet a2610a3bb0aa4946ab63a9b653d9a6df (table test-table [id=2ccaf9714d86450b998b0d17aec77603]) successfully deleted
I20260807 22:47:34.405050 14500 catalog_manager.cc:4841] TS 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247): tablet a2610a3bb0aa4946ab63a9b653d9a6df (table test-table [id=2ccaf9714d86450b998b0d17aec77603]) successfully deleted
I20260807 22:47:34.406457 15101 tablet_bootstrap.cc:492] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087: No bootstrap required, opened a new log
I20260807 22:47:34.406517 15103 tablet_bootstrap.cc:492] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232: Bootstrap starting.
I20260807 22:47:34.406644 15101 ts_tablet_manager.cc:1397] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260807 22:47:34.407217 15101 raft_consensus.cc:348] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.407459 15101 raft_consensus.cc:374] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:34.407521 15101 raft_consensus.cc:729] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c5f4dc5d0e40edbabd7d95e9e95087, State: Initialized, Role: FOLLOWER
I20260807 22:47:34.407661 15101 consensus_queue.cc:260] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.408030 15102 tablet_bootstrap.cc:492] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e: No bootstrap required, opened a new log
I20260807 22:47:34.408134 15102 ts_tablet_manager.cc:1397] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260807 22:47:34.408444 15101 ts_tablet_manager.cc:1428] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:34.408653 15102 raft_consensus.cc:348] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.408768 15102 raft_consensus.cc:374] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:34.408800 15102 raft_consensus.cc:729] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbb1cee69044fedb30c1b03b5e9444e, State: Initialized, Role: FOLLOWER
I20260807 22:47:34.408941 15102 consensus_queue.cc:260] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.409209 15102 ts_tablet_manager.cc:1428] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:47:34.409358 15103 tablet_bootstrap.cc:654] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:34.411185 15103 tablet_bootstrap.cc:492] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232: No bootstrap required, opened a new log
I20260807 22:47:34.411278 15103 ts_tablet_manager.cc:1397] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260807 22:47:34.411845 15103 raft_consensus.cc:348] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.411990 15103 raft_consensus.cc:374] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:34.412029 15103 raft_consensus.cc:729] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 343259e98ef249938ff56c20ef8c7232, State: Initialized, Role: FOLLOWER
I20260807 22:47:34.412147 15103 consensus_queue.cc:260] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.412953 15103 ts_tablet_manager.cc:1428] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:34.451977 15092 raft_consensus.cc:482] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:34.452122 15092 raft_consensus.cc:504] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.452545 15092 leader_election.cc:288] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709), 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247)
I20260807 22:47:34.453024 14971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011f7dea800644989c1cba3acee4f792" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "343259e98ef249938ff56c20ef8c7232" is_pre_election: true
I20260807 22:47:34.453013 14682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011f7dea800644989c1cba3acee4f792" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" is_pre_election: true
I20260807 22:47:34.453153 14971 raft_consensus.cc:2454] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 0.
I20260807 22:47:34.453167 14682 raft_consensus.cc:2454] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 0.
I20260807 22:47:34.453569 14760 leader_election.cc:302] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 343259e98ef249938ff56c20ef8c7232, e5c5f4dc5d0e40edbabd7d95e9e95087; no voters:
I20260807 22:47:34.453778 15092 raft_consensus.cc:2781] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:34.453845 15092 raft_consensus.cc:482] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:34.453876 15092 raft_consensus.cc:3037] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:34.454957 15092 raft_consensus.cc:504] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.455299 15092 leader_election.cc:288] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 election: Requested vote from peers 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709), 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247)
I20260807 22:47:34.455632 14971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011f7dea800644989c1cba3acee4f792" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "343259e98ef249938ff56c20ef8c7232"
I20260807 22:47:34.455744 14971 raft_consensus.cc:3037] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:34.455704 14682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011f7dea800644989c1cba3acee4f792" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbb1cee69044fedb30c1b03b5e9444e"
I20260807 22:47:34.455837 14682 raft_consensus.cc:3037] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:34.456957 14971 raft_consensus.cc:2454] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 1.
I20260807 22:47:34.456957 14682 raft_consensus.cc:2454] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 1.
I20260807 22:47:34.457237 14760 leader_election.cc:302] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 343259e98ef249938ff56c20ef8c7232, e5c5f4dc5d0e40edbabd7d95e9e95087; no voters:
I20260807 22:47:34.457430 15092 raft_consensus.cc:2781] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:34.457543 15092 raft_consensus.cc:686] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 LEADER]: Becoming Leader. State: Replica: e5c5f4dc5d0e40edbabd7d95e9e95087, State: Running, Role: LEADER
I20260807 22:47:34.457692 15092 consensus_queue.cc:237] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:34.459409 14512 catalog_manager.cc:5495] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194). New cstate: current_term: 1 leader_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } health_report { overall_health: UNKNOWN } } }
I20260807 22:47:34.485224 15071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.481830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54300 (local address 127.12.112.194:34039)
0807 22:47:34.481961 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:34.481964 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:34.482065 (+ 101us) server_negotiation.cc:407] Connection header received
0807 22:47:34.482199 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:34.482201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:34.482242 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:34.482321 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:34.482585 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.483085 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.484187 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.484402 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.484476 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.484760 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:34.484831 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:34.484883 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:34.485017 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 22:47:34.485061 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:47:34.494392 15071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.490901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:42297 (local address 127.12.112.194:34039)
0807 22:47:34.490998 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:34.491005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:34.491023 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:47:34.491169 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:34.491172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:34.491215 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:34.491293 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:34.491582 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.492063 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.493206 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.493472 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.493550 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.493897 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:34.493963 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:34.494017 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:34.494150 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 22:47:34.494193 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":37}
I20260807 22:47:34.494406 15094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:34.490800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:34039 (local address 127.12.112.194:42297)
0807 22:47:34.490959 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:34.490974 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:34.491066 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:34.491325 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:34.491328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:34.491339 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:47:34.491466 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.491472 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.492176 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.492179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.493094 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:34.493107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:34.493585 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:34.493588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:34.493678 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:34.493716 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:47:34.494052 (+ 336us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:47:34.494060 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:47:34.494133 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 22:47:34.494219 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":1}
I20260807 22:47:34.500417 14971 raft_consensus.cc:1261] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Refusing update from remote peer e5c5f4dc5d0e40edbabd7d95e9e95087: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:34.500792 14682 raft_consensus.cc:1261] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Refusing update from remote peer e5c5f4dc5d0e40edbabd7d95e9e95087: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:34.500890 15110 consensus_queue.cc:1035] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:34.501224 15110 consensus_queue.cc:1035] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:34.503274 15072 mvcc.cc:205] Tried to move back new op lower bound from 7316041132030615552 to 7316041131860021248. Current Snapshot: MvccSnapshot[applied={T|T < 7316041132030615552}]
W20260807 22:47:34.516702 15072 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 22:47:36.097673 14512 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:36.097890 14512 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:36.101558 14512 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82: Sending DeleteTablet for 3 replicas of tablet 011f7dea800644989c1cba3acee4f792
I20260807 22:47:36.102528 14657 tablet_service.cc:1514] Processing DeleteTablet for tablet 011f7dea800644989c1cba3acee4f792 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:36 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:49150
I20260807 22:47:36.102525 14807 tablet_service.cc:1514] Processing DeleteTablet for tablet 011f7dea800644989c1cba3acee4f792 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:36 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:54290
I20260807 22:47:36.102720 14950 tablet_service.cc:1514] Processing DeleteTablet for tablet 011f7dea800644989c1cba3acee4f792 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:36 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:37532
I20260807 22:47:36.103323 15133 tablet_replica.cc:330] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087: stopping tablet replica
I20260807 22:47:36.103144 15134 tablet_replica.cc:330] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e: stopping tablet replica
I20260807 22:47:36.103606 15135 tablet_replica.cc:330] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232: stopping tablet replica
I20260807 22:47:36.103624 15134 raft_consensus.cc:2229] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:36.103624 15133 raft_consensus.cc:2229] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:47:36.103823 15134 raft_consensus.cc:2258] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:36.104013 15135 raft_consensus.cc:2229] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:36.104210 15133 raft_consensus.cc:2258] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:36.104317 15135 raft_consensus.cc:2258] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:36.105129 15134 ts_tablet_manager.cc:1905] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:36.105322 15133 ts_tablet_manager.cc:1905] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:36.105682 15135 ts_tablet_manager.cc:1905] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:36.109988 15134 ts_tablet_manager.cc:1918] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:47:36.110096 15133 ts_tablet_manager.cc:1918] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:47:36.110212 15134 log.cc:1196] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/011f7dea800644989c1cba3acee4f792
I20260807 22:47:36.110339 15133 log.cc:1196] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/011f7dea800644989c1cba3acee4f792
I20260807 22:47:36.110641 15135 ts_tablet_manager.cc:1918] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:47:36.110899 15135 log.cc:1196] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/011f7dea800644989c1cba3acee4f792
I20260807 22:47:36.110981 15134 ts_tablet_manager.cc:1939] T 011f7dea800644989c1cba3acee4f792 P 1cbb1cee69044fedb30c1b03b5e9444e: Deleting consensus metadata
I20260807 22:47:36.111086 15133 ts_tablet_manager.cc:1939] T 011f7dea800644989c1cba3acee4f792 P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting consensus metadata
I20260807 22:47:36.111534 15135 ts_tablet_manager.cc:1939] T 011f7dea800644989c1cba3acee4f792 P 343259e98ef249938ff56c20ef8c7232: Deleting consensus metadata
I20260807 22:47:36.112418 14501 catalog_manager.cc:4841] TS e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194:34039): tablet 011f7dea800644989c1cba3acee4f792 (table test-table [id=78937edbbbab437da10b000e3e71a634]) successfully deleted
I20260807 22:47:36.112418 14499 catalog_manager.cc:4841] TS 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709): tablet 011f7dea800644989c1cba3acee4f792 (table test-table [id=78937edbbbab437da10b000e3e71a634]) successfully deleted
I20260807 22:47:36.113107 14500 catalog_manager.cc:4841] TS 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247): tablet 011f7dea800644989c1cba3acee4f792 (table test-table [id=78937edbbbab437da10b000e3e71a634]) successfully deleted
Aug 07 22:47:36 dist-test-slave-tm1g krb5kdc[14469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142856, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:47:36 dist-test-slave-tm1g krb5kdc[14469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142856, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:36.159711 15143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.137868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54100 (local address 127.12.112.254:34309)
0807 22:47:36.138414 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:36.138428 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:36.138567 (+ 139us) server_negotiation.cc:407] Connection header received
0807 22:47:36.138856 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:36.138860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:36.138936 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:36.139097 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:36.140340 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.141346 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.143008 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.143395 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.143625 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.153931 (+ 10306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:36.153936 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:36.153938 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:36.154016 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:36.156529 (+ 2513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:36.157434 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:36.157445 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:36.157447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:36.157576 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:36.158015 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:36.158029 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:36.158030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:36.158463 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:36.158744 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:36.159185 (+ 441us) server_negotiation.cc:299] Negotiation successful
0807 22:47:36.159411 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":213,"threads_started":1}
I20260807 22:47:36.163693 14512 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:47:36.164323 14512 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:36.171928 14657 tablet_service.cc:1467] Processing CreateTablet for tablet dda42e67a3a94d4d84bcd1ff53e1bb37 (DEFAULT_TABLE table=test-table [id=812c5c6b441e4c44a3edd4e122e1e59a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:36.172452 14950 tablet_service.cc:1467] Processing CreateTablet for tablet dda42e67a3a94d4d84bcd1ff53e1bb37 (DEFAULT_TABLE table=test-table [id=812c5c6b441e4c44a3edd4e122e1e59a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:36.172554 14657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dda42e67a3a94d4d84bcd1ff53e1bb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:36.172570 14807 tablet_service.cc:1467] Processing CreateTablet for tablet dda42e67a3a94d4d84bcd1ff53e1bb37 (DEFAULT_TABLE table=test-table [id=812c5c6b441e4c44a3edd4e122e1e59a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:36.172823 14950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dda42e67a3a94d4d84bcd1ff53e1bb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:36.173074 14807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dda42e67a3a94d4d84bcd1ff53e1bb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:36.177500 15145 tablet_bootstrap.cc:492] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232: Bootstrap starting.
I20260807 22:47:36.177659 15146 tablet_bootstrap.cc:492] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087: Bootstrap starting.
I20260807 22:47:36.177747 15144 tablet_bootstrap.cc:492] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e: Bootstrap starting.
I20260807 22:47:36.179481 15145 tablet_bootstrap.cc:654] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:36.179509 15144 tablet_bootstrap.cc:654] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:36.179543 15146 tablet_bootstrap.cc:654] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:36.181499 15145 tablet_bootstrap.cc:492] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232: No bootstrap required, opened a new log
I20260807 22:47:36.181617 15145 ts_tablet_manager.cc:1397] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260807 22:47:36.182047 15144 tablet_bootstrap.cc:492] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e: No bootstrap required, opened a new log
I20260807 22:47:36.182205 15144 ts_tablet_manager.cc:1397] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 22:47:36.182386 15146 tablet_bootstrap.cc:492] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087: No bootstrap required, opened a new log
I20260807 22:47:36.182350 15145 raft_consensus.cc:348] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.182569 15146 ts_tablet_manager.cc:1397] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 22:47:36.182613 15145 raft_consensus.cc:374] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:36.182698 15145 raft_consensus.cc:729] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 343259e98ef249938ff56c20ef8c7232, State: Initialized, Role: FOLLOWER
I20260807 22:47:36.182914 15145 consensus_queue.cc:260] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.183068 15144 raft_consensus.cc:348] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.183276 15144 raft_consensus.cc:374] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:36.183347 15144 raft_consensus.cc:729] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbb1cee69044fedb30c1b03b5e9444e, State: Initialized, Role: FOLLOWER
I20260807 22:47:36.183261 15146 raft_consensus.cc:348] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.183490 15146 raft_consensus.cc:374] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:36.183565 15146 raft_consensus.cc:729] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c5f4dc5d0e40edbabd7d95e9e95087, State: Initialized, Role: FOLLOWER
I20260807 22:47:36.183719 15145 ts_tablet_manager.cc:1428] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:36.183661 15144 consensus_queue.cc:260] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.183773 15146 consensus_queue.cc:260] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.184334 15146 ts_tablet_manager.cc:1428] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:36.184355 15144 ts_tablet_manager.cc:1428] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:36.238852 15120 raft_consensus.cc:482] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:36.239118 15120 raft_consensus.cc:504] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.239938 15120 leader_election.cc:288] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709), 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247)
I20260807 22:47:36.240520 14683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda42e67a3a94d4d84bcd1ff53e1bb37" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" is_pre_election: true
I20260807 22:47:36.240669 14971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda42e67a3a94d4d84bcd1ff53e1bb37" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "343259e98ef249938ff56c20ef8c7232" is_pre_election: true
I20260807 22:47:36.240829 14683 raft_consensus.cc:2454] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 0.
I20260807 22:47:36.240979 14971 raft_consensus.cc:2454] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 0.
I20260807 22:47:36.241376 14759 leader_election.cc:302] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbb1cee69044fedb30c1b03b5e9444e, e5c5f4dc5d0e40edbabd7d95e9e95087; no voters:
I20260807 22:47:36.241693 15120 raft_consensus.cc:2781] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:36.241779 15120 raft_consensus.cc:482] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:36.241875 15120 raft_consensus.cc:3037] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:36.243681 15120 raft_consensus.cc:504] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.244282 15120 leader_election.cc:288] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 election: Requested vote from peers 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709), 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247)
I20260807 22:47:36.244702 14683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda42e67a3a94d4d84bcd1ff53e1bb37" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbb1cee69044fedb30c1b03b5e9444e"
I20260807 22:47:36.244837 14971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda42e67a3a94d4d84bcd1ff53e1bb37" candidate_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "343259e98ef249938ff56c20ef8c7232"
I20260807 22:47:36.244921 14683 raft_consensus.cc:3037] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:36.244987 14971 raft_consensus.cc:3037] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:36.246412 14683 raft_consensus.cc:2454] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 1.
I20260807 22:47:36.246738 14971 raft_consensus.cc:2454] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c5f4dc5d0e40edbabd7d95e9e95087 in term 1.
I20260807 22:47:36.246969 14759 leader_election.cc:302] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbb1cee69044fedb30c1b03b5e9444e, e5c5f4dc5d0e40edbabd7d95e9e95087; no voters:
I20260807 22:47:36.247259 15120 raft_consensus.cc:2781] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:36.247437 15120 raft_consensus.cc:686] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 LEADER]: Becoming Leader. State: Replica: e5c5f4dc5d0e40edbabd7d95e9e95087, State: Running, Role: LEADER
I20260807 22:47:36.247717 15120 consensus_queue.cc:237] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.250634 14514 catalog_manager.cc:5495] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194). New cstate: current_term: 1 leader_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } health_report { overall_health: UNKNOWN } } }
I20260807 22:47:36.274607 15156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.269296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54302 (local address 127.12.112.194:34039)
0807 22:47:36.269747 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:36.269760 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:36.269788 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:47:36.269882 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:36.269886 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:36.269955 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:36.270093 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:36.270549 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.271362 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.272756 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.273146 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.273322 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.273776 (+ 454us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:36.273899 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:36.274005 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:36.274192 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 22:47:36.274344 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":179,"threads_started":1}
I20260807 22:47:36.283886 14971 raft_consensus.cc:1261] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Refusing update from remote peer e5c5f4dc5d0e40edbabd7d95e9e95087: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:36.283900 14683 raft_consensus.cc:1261] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Refusing update from remote peer e5c5f4dc5d0e40edbabd7d95e9e95087: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:36.284539 15128 consensus_queue.cc:1035] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:36.284760 15120 consensus_queue.cc:1035] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:36.336680 14513 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:36.336920 14513 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:36.339995 14513 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82: Sending DeleteTablet for 3 replicas of tablet dda42e67a3a94d4d84bcd1ff53e1bb37
I20260807 22:47:36.340885 14657 tablet_service.cc:1514] Processing DeleteTablet for tablet dda42e67a3a94d4d84bcd1ff53e1bb37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:36 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:49150
I20260807 22:47:36.341074 14950 tablet_service.cc:1514] Processing DeleteTablet for tablet dda42e67a3a94d4d84bcd1ff53e1bb37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:36 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:37532
I20260807 22:47:36.341224 15134 tablet_replica.cc:330] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e: stopping tablet replica
I20260807 22:47:36.341395 15135 tablet_replica.cc:330] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232: stopping tablet replica
I20260807 22:47:36.341473 15134 raft_consensus.cc:2229] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:36.341679 15135 raft_consensus.cc:2229] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:36.341710 15134 raft_consensus.cc:2258] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:36.341876 15135 raft_consensus.cc:2258] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:36.342060 14798 tablet_service.cc:1514] Processing DeleteTablet for tablet dda42e67a3a94d4d84bcd1ff53e1bb37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:36 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:54290
I20260807 22:47:36.342444 15133 tablet_replica.cc:330] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087: stopping tablet replica
I20260807 22:47:36.342674 15133 raft_consensus.cc:2229] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:47:36.343030 15133 raft_consensus.cc:2258] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:36.343088 14513 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 22:47:36.343425 15135 ts_tablet_manager.cc:1905] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:36.343489 15134 ts_tablet_manager.cc:1905] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 22:47:36.343762 14513 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:36.344617 15133 ts_tablet_manager.cc:1905] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:36.348183 15134 ts_tablet_manager.cc:1918] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:47:36.348271 15134 log.cc:1196] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/dda42e67a3a94d4d84bcd1ff53e1bb37
I20260807 22:47:36.348289 15135 ts_tablet_manager.cc:1918] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:47:36.348414 15135 log.cc:1196] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/dda42e67a3a94d4d84bcd1ff53e1bb37
I20260807 22:47:36.348599 15134 ts_tablet_manager.cc:1939] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 1cbb1cee69044fedb30c1b03b5e9444e: Deleting consensus metadata
I20260807 22:47:36.349017 15135 ts_tablet_manager.cc:1939] T dda42e67a3a94d4d84bcd1ff53e1bb37 P 343259e98ef249938ff56c20ef8c7232: Deleting consensus metadata
I20260807 22:47:36.349493 15133 ts_tablet_manager.cc:1918] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:47:36.349609 15133 log.cc:1196] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/dda42e67a3a94d4d84bcd1ff53e1bb37
I20260807 22:47:36.349660 14499 catalog_manager.cc:4841] TS 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709): tablet dda42e67a3a94d4d84bcd1ff53e1bb37 (table test-table [id=812c5c6b441e4c44a3edd4e122e1e59a]) successfully deleted
I20260807 22:47:36.350121 15133 ts_tablet_manager.cc:1939] T dda42e67a3a94d4d84bcd1ff53e1bb37 P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting consensus metadata
I20260807 22:47:36.350452 14500 catalog_manager.cc:4841] TS 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247): tablet dda42e67a3a94d4d84bcd1ff53e1bb37 (table test-table [id=812c5c6b441e4c44a3edd4e122e1e59a]) successfully deleted
I20260807 22:47:36.351540 14501 catalog_manager.cc:4841] TS e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194:34039): tablet dda42e67a3a94d4d84bcd1ff53e1bb37 (table test-table [id=812c5c6b441e4c44a3edd4e122e1e59a]) successfully deleted
I20260807 22:47:36.354835 14657 tablet_service.cc:1467] Processing CreateTablet for tablet b8df53e68af74cf094c7d733f063129b (DEFAULT_TABLE table=test-table [id=6a0ce32468df43d8ba30dcadef742a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:36.354908 14798 tablet_service.cc:1467] Processing CreateTablet for tablet b8df53e68af74cf094c7d733f063129b (DEFAULT_TABLE table=test-table [id=6a0ce32468df43d8ba30dcadef742a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:36.355136 14950 tablet_service.cc:1467] Processing CreateTablet for tablet b8df53e68af74cf094c7d733f063129b (DEFAULT_TABLE table=test-table [id=6a0ce32468df43d8ba30dcadef742a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:36.355336 14657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8df53e68af74cf094c7d733f063129b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:36.355397 14798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8df53e68af74cf094c7d733f063129b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:36.355561 14950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8df53e68af74cf094c7d733f063129b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:36.358151 15144 tablet_bootstrap.cc:492] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e: Bootstrap starting.
I20260807 22:47:36.359673 15145 tablet_bootstrap.cc:492] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232: Bootstrap starting.
I20260807 22:47:36.360373 15144 tablet_bootstrap.cc:654] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:36.360975 15145 tablet_bootstrap.cc:654] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:36.361963 15146 tablet_bootstrap.cc:492] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087: Bootstrap starting.
I20260807 22:47:36.363169 15144 tablet_bootstrap.cc:492] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e: No bootstrap required, opened a new log
I20260807 22:47:36.363358 15144 ts_tablet_manager.cc:1397] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:47:36.363749 15146 tablet_bootstrap.cc:654] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:36.363476 15145 tablet_bootstrap.cc:492] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232: No bootstrap required, opened a new log
I20260807 22:47:36.364226 15145 ts_tablet_manager.cc:1397] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260807 22:47:36.364270 15144 raft_consensus.cc:348] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.364547 15144 raft_consensus.cc:374] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:36.364615 15144 raft_consensus.cc:729] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbb1cee69044fedb30c1b03b5e9444e, State: Initialized, Role: FOLLOWER
I20260807 22:47:36.364859 15144 consensus_queue.cc:260] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.365034 15145 raft_consensus.cc:348] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.365296 15145 raft_consensus.cc:374] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:36.365355 15145 raft_consensus.cc:729] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 343259e98ef249938ff56c20ef8c7232, State: Initialized, Role: FOLLOWER
I20260807 22:47:36.365510 15144 ts_tablet_manager.cc:1428] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 22:47:36.365603 15145 consensus_queue.cc:260] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.365916 15146 tablet_bootstrap.cc:492] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087: No bootstrap required, opened a new log
I20260807 22:47:36.366075 15146 ts_tablet_manager.cc:1397] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 22:47:36.366588 15146 raft_consensus.cc:348] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.366797 15146 raft_consensus.cc:374] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:36.366902 15146 raft_consensus.cc:729] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c5f4dc5d0e40edbabd7d95e9e95087, State: Initialized, Role: FOLLOWER
I20260807 22:47:36.366959 15145 ts_tablet_manager.cc:1428] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 22:47:36.367178 15146 consensus_queue.cc:260] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.367686 15146 ts_tablet_manager.cc:1428] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 22:47:36.499931 15153 raft_consensus.cc:482] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:36.500147 15153 raft_consensus.cc:504] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.501921 15153 leader_election.cc:288] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194:34039), 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247)
I20260807 22:47:36.510557 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.502458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:59863 (local address 127.12.112.195:42247)
0807 22:47:36.502913 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:36.502929 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:36.503050 (+ 121us) server_negotiation.cc:407] Connection header received
0807 22:47:36.503238 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:36.503241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:36.503324 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:36.503484 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:36.504115 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.505355 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.508420 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.509400 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.509599 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.509691 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:36.510142 (+ 451us) server_negotiation.cc:299] Negotiation successful
0807 22:47:36.510276 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":162,"threads_started":1}
I20260807 22:47:36.510553 15156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.502851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:35521 (local address 127.12.112.194:34039)
0807 22:47:36.503081 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:36.503089 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:36.503123 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:47:36.503232 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:36.503235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:36.503324 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:36.503484 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:36.504116 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.505355 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.508432 (+ 3077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.509379 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.509598 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.509691 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:36.510143 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 22:47:36.510276 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 22:47:36.510735 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.502284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:34039 (local address 127.12.112.193:35521)
0807 22:47:36.502789 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:36.502821 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:36.503021 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:36.503495 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:36.503498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:36.503576 (+ 78us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:36.503932 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:36.503941 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.505561 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.505568 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:36.508222 (+ 2654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:36.508232 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.509576 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.509590 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:36.509850 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.509989 (+ 139us) client_negotiation.cc:769] Sending connection context
0807 22:47:36.510120 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 22:47:36.510353 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":407,"spinlock_wait_cycles":54656,"thread_start_us":119,"threads_started":1}
I20260807 22:47:36.510735 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.502284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:42247 (local address 127.12.112.193:59863)
0807 22:47:36.502920 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:36.502934 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:36.503079 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:36.503495 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:36.503498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:36.503573 (+ 75us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:36.503937 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:36.503942 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.505588 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.505591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:36.508220 (+ 2629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:36.508232 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.509576 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.509590 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:36.509863 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.509986 (+ 123us) client_negotiation.cc:769] Sending connection context
0807 22:47:36.510119 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 22:47:36.510353 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":555,"spinlock_wait_cycles":3200,"thread_start_us":200,"threads_started":1}
I20260807 22:47:36.511510 14828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8df53e68af74cf094c7d733f063129b" candidate_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" is_pre_election: true
I20260807 22:47:36.511766 14828 raft_consensus.cc:2454] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbb1cee69044fedb30c1b03b5e9444e in term 0.
I20260807 22:47:36.511904 14971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8df53e68af74cf094c7d733f063129b" candidate_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "343259e98ef249938ff56c20ef8c7232" is_pre_election: true
I20260807 22:47:36.512151 14971 raft_consensus.cc:2454] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbb1cee69044fedb30c1b03b5e9444e in term 0.
I20260807 22:47:36.512427 14607 leader_election.cc:302] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbb1cee69044fedb30c1b03b5e9444e, e5c5f4dc5d0e40edbabd7d95e9e95087; no voters:
I20260807 22:47:36.512861 15153 raft_consensus.cc:2781] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:36.512960 15153 raft_consensus.cc:482] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:36.513016 15153 raft_consensus.cc:3037] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:36.515247 15153 raft_consensus.cc:504] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.515798 15153 leader_election.cc:288] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [CANDIDATE]: Term 1 election: Requested vote from peers e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194:34039), 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247)
I20260807 22:47:36.516223 14828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8df53e68af74cf094c7d733f063129b" candidate_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087"
I20260807 22:47:36.516263 14971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8df53e68af74cf094c7d733f063129b" candidate_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "343259e98ef249938ff56c20ef8c7232"
I20260807 22:47:36.516414 14828 raft_consensus.cc:3037] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:36.516448 14971 raft_consensus.cc:3037] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:36.517886 14971 raft_consensus.cc:2454] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbb1cee69044fedb30c1b03b5e9444e in term 1.
I20260807 22:47:36.517890 14828 raft_consensus.cc:2454] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbb1cee69044fedb30c1b03b5e9444e in term 1.
I20260807 22:47:36.518285 14607 leader_election.cc:302] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbb1cee69044fedb30c1b03b5e9444e, e5c5f4dc5d0e40edbabd7d95e9e95087; no voters:
I20260807 22:47:36.518567 15153 raft_consensus.cc:2781] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:36.518853 15153 raft_consensus.cc:686] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [term 1 LEADER]: Becoming Leader. State: Replica: 1cbb1cee69044fedb30c1b03b5e9444e, State: Running, Role: LEADER
I20260807 22:47:36.519236 15153 consensus_queue.cc:237] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } }
I20260807 22:47:36.522979 14513 catalog_manager.cc:5495] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193). New cstate: current_term: 1 leader_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbb1cee69044fedb30c1b03b5e9444e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 } health_report { overall_health: UNKNOWN } } }
I20260807 22:47:36.578645 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.572381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49152 (local address 127.12.112.193:46709)
0807 22:47:36.572836 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:36.572843 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:36.572866 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:47:36.573013 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:36.573015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:36.573114 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:36.573271 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:36.573865 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.574864 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.576187 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.576556 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.576702 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.577132 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:36.577992 (+ 860us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:36.578131 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:36.578260 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 22:47:36.578415 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":234,"threads_started":1}
I20260807 22:47:36.593940 15156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.589178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:53537 (local address 127.12.112.194:34039)
0807 22:47:36.589389 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:36.589394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:36.589576 (+ 182us) server_negotiation.cc:407] Connection header received
0807 22:47:36.589759 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:36.589770 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:36.589840 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:36.589948 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:36.590228 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.591055 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.592252 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.592588 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.592770 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.593203 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:36.593328 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:36.593459 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:36.593663 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 22:47:36.593774 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:47:36.593986 15171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.588997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:34039 (local address 127.12.112.193:53537)
0807 22:47:36.589450 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:36.589464 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:36.589621 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:36.589958 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:36.589960 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:36.589975 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:47:36.590110 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:36.590116 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.591195 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.591198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:36.592095 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:36.592105 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.592783 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.592797 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:36.592912 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.592976 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:47:36.593480 (+ 504us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:47:36.593500 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 22:47:36.593613 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:47:36.593756 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":138,"threads_started":1}
I20260807 22:47:36.603678 14971 raft_consensus.cc:1261] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Refusing update from remote peer 1cbb1cee69044fedb30c1b03b5e9444e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:36.603873 14828 raft_consensus.cc:1261] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Refusing update from remote peer 1cbb1cee69044fedb30c1b03b5e9444e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:36.604425 15153 consensus_queue.cc:1035] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [LEADER]: Connected to new peer: Peer: permanent_uuid: "343259e98ef249938ff56c20ef8c7232" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:36.604678 15166 consensus_queue.cc:1035] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5c5f4dc5d0e40edbabd7d95e9e95087" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:36.609551 15116 mvcc.cc:205] Tried to move back new op lower bound from 7316041140641005568 to 7316041140307238912. Current Snapshot: MvccSnapshot[applied={T|T < 7316041140641005568}]
I20260807 22:47:36.632067 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.626734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:56119 (local address 127.12.112.193:46709)
0807 22:47:36.626903 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:36.626914 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:36.627268 (+ 354us) server_negotiation.cc:407] Connection header received
0807 22:47:36.627530 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:36.627534 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:36.627619 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:36.627759 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:36.628163 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.629093 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.630654 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.630994 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.631113 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.631524 (+ 411us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:36.631649 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:36.631759 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:36.631836 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 22:47:36.631899 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:47:36.632133 15176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:36.626674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:46709 (local address 127.12.112.194:56119)
0807 22:47:36.627144 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:36.627167 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:36.627333 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:36.627774 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:36.627777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:36.627796 (+ 19us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:47:36.627992 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:36.628007 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.629324 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.629328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:36.630479 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:36.630498 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:36.631153 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:36.631165 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:36.631284 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:36.631324 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:47:36.631760 (+ 436us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:47:36.631765 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:47:36.631828 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 22:47:36.631939 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":231,"threads_started":1}
W20260807 22:47:36.633319 15116 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 22:47:38.240278 14514 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:38.240578 14514 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:38.244849 14514 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 024d0f08d9c44b1fa1c19c2d2feb6c82: Sending DeleteTablet for 3 replicas of tablet b8df53e68af74cf094c7d733f063129b
I20260807 22:47:38.245771 14657 tablet_service.cc:1514] Processing DeleteTablet for tablet b8df53e68af74cf094c7d733f063129b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:38 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:49150
I20260807 22:47:38.245886 14798 tablet_service.cc:1514] Processing DeleteTablet for tablet b8df53e68af74cf094c7d733f063129b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:38 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:54290
I20260807 22:47:38.245954 14950 tablet_service.cc:1514] Processing DeleteTablet for tablet b8df53e68af74cf094c7d733f063129b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:38 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:37532
I20260807 22:47:38.246582 15201 tablet_replica.cc:330] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087: stopping tablet replica
I20260807 22:47:38.246582 15200 tablet_replica.cc:330] T b8df53e68af74cf094c7d733f063129b P 1cbb1cee69044fedb30c1b03b5e9444e: stopping tablet replica
I20260807 22:47:38.246666 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 14588
I20260807 22:47:38.246721 15202 tablet_replica.cc:330] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232: stopping tablet replica
I20260807 22:47:38.250161 15202 raft_consensus.cc:2229] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:38.250490 15202 raft_consensus.cc:2258] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:38.251658 15201 raft_consensus.cc:2229] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:38.251938 15201 raft_consensus.cc:2258] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:38.252231 15202 ts_tablet_manager.cc:1905] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:38.253209 15201 ts_tablet_manager.cc:1905] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:38.258121 15201 ts_tablet_manager.cc:1918] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:47:38.258211 15201 log.cc:1196] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/b8df53e68af74cf094c7d733f063129b
I20260807 22:47:38.258769 15201 ts_tablet_manager.cc:1939] T b8df53e68af74cf094c7d733f063129b P e5c5f4dc5d0e40edbabd7d95e9e95087: Deleting consensus metadata
I20260807 22:47:38.259892 15202 ts_tablet_manager.cc:1918] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:47:38.260022 15202 log.cc:1196] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/b8df53e68af74cf094c7d733f063129b
I20260807 22:47:38.260196 14501 catalog_manager.cc:4841] TS e5c5f4dc5d0e40edbabd7d95e9e95087 (127.12.112.194:34039): tablet b8df53e68af74cf094c7d733f063129b (table test-table [id=6a0ce32468df43d8ba30dcadef742a26]) successfully deleted
I20260807 22:47:38.260844 15202 ts_tablet_manager.cc:1939] T b8df53e68af74cf094c7d733f063129b P 343259e98ef249938ff56c20ef8c7232: Deleting consensus metadata
I20260807 22:47:38.262084 14500 catalog_manager.cc:4841] TS 343259e98ef249938ff56c20ef8c7232 (127.12.112.195:42247): tablet b8df53e68af74cf094c7d733f063129b (table test-table [id=6a0ce32468df43d8ba30dcadef742a26]) successfully deleted
W20260807 22:47:38.270539 14499 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:46709 (error 108)
I20260807 22:47:38.271605 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 14741
I20260807 22:47:38.275032 15204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:38.273299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:46709 (local address 127.0.0.1:49154)
0807 22:47:38.274432 (+ 1133us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:38.274616 (+ 184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:46709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":919,"thread_start_us":567,"threads_started":1}
W20260807 22:47:38.275274 14499 catalog_manager.cc:4584] TS 1cbb1cee69044fedb30c1b03b5e9444e (127.12.112.193:46709): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b8df53e68af74cf094c7d733f063129b: Network error: Client connection negotiation failed: client connection to 127.12.112.193:46709: connect: Connection refused (error 111)
I20260807 22:47:38.289958 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 14884
I20260807 22:47:38.303174 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 14482
2026-08-07T22:47:38Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6961 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:38 dist-test-slave-tm1g krb5kdc[15207](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:38 dist-test-slave-tm1g krb5kdc[15207](info): set up 2 sockets
Aug 07 22:47:38 dist-test-slave-tm1g krb5kdc[15207](info): commencing operation
krb5kdc: starting...
W20260807 22:47:39.445604 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:39 dist-test-slave-tm1g krb5kdc[15207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:47:39.565418 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:40535
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:40535
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:39.675549 15220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:39.675868 15220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:39.675948 15220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:39.680567 15220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:39.680670 15220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:39.680711 15220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:39.680750 15220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:39.680786 15220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:39.686163 15220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:40535
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:40535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:39.687248 15220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:39.688259 15220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:39.696583 15228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:39.696550 15226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:39.696537 15225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:39.696653 15220 server_base.cc:1034] running on GCE node
I20260807 22:47:39.697348 15220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:39.698454 15220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:39.699608 15220 hybrid_clock.cc:648] HybridClock initialized: now 1786142859699583 us; error 38 us; skew 500 ppm
Aug 07 22:47:39 dist-test-slave-tm1g krb5kdc[15207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142859, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:39.702358 15220 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:47:39.703207 15220 webserver.cc:460] Webserver started at http://127.12.112.254:33643/ using document root <none> and password file <none>
I20260807 22:47:39.703760 15220 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:39.703847 15220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:39.704072 15220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:39.706481 15220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2"
format_stamp: "Formatted at 2026-08-07 22:47:39 on dist-test-slave-tm1g"
server_key: "1491254152010bd29610e25d27435b4a"
server_key_iv: "1464b5349e7d4ea2e39b675ebe8d8620"
server_key_version: "encryptionkey@0"
I20260807 22:47:39.707044 15220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2"
format_stamp: "Formatted at 2026-08-07 22:47:39 on dist-test-slave-tm1g"
server_key: "1491254152010bd29610e25d27435b4a"
server_key_iv: "1464b5349e7d4ea2e39b675ebe8d8620"
server_key_version: "encryptionkey@0"
I20260807 22:47:39.710625 15220 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:47:39.712846 15235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:39.713981 15220 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:39.714109 15220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2"
format_stamp: "Formatted at 2026-08-07 22:47:39 on dist-test-slave-tm1g"
server_key: "1491254152010bd29610e25d27435b4a"
server_key_iv: "1464b5349e7d4ea2e39b675ebe8d8620"
server_key_version: "encryptionkey@0"
I20260807 22:47:39.714212 15220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:39.734508 15220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:39.737732 15220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:39.737941 15220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:39.746186 15220 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:40535
I20260807 22:47:39.746542 15289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:40535 every 8 connection(s)
I20260807 22:47:39.747529 15220 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:39.750288 15290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:39.751386 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 15220
I20260807 22:47:39.751475 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:39.751750 12739 external_mini_cluster.cc:1428] Setting key 3ebb0f6b782b21f8bc3ac8770d697160
I20260807 22:47:39.757388 15290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2: Bootstrap starting.
I20260807 22:47:39.759858 15290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:39.760592 15290 log.cc:824] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:47:39 dist-test-slave-tm1g krb5kdc[15207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:39.762722 15290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2: No bootstrap required, opened a new log
I20260807 22:47:39.766701 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:39.753158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57922 (local address 127.12.112.254:40535)
0807 22:47:39.753605 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:39.753629 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:39.753674 (+ 45us) server_negotiation.cc:407] Connection header received
0807 22:47:39.754559 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:39.754582 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:39.754982 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:39.755337 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:39.756002 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:39.757511 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:39.758386 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:39.759084 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:39.759231 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:39.761938 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:39.761943 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:39.761956 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:39.761992 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:39.763854 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:39.764341 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:39.764345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:39.764350 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:39.764458 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:39.764766 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:39.764768 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:39.764769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:39.765144 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:39.765309 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:39.765598 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 22:47:39.765906 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":114,"threads_started":1}
I20260807 22:47:39.766711 15290 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 40535 } }
I20260807 22:47:39.767067 15290 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:39.767135 15290 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6828d7ec451e42c6a9f5e8cd710dfbd2, State: Initialized, Role: FOLLOWER
I20260807 22:47:39.767536 15290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 40535 } }
I20260807 22:47:39.767684 15290 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:39.767800 15290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:39.767906 15290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:39.769018 15290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 40535 } }
I20260807 22:47:39.769321 15290 leader_election.cc:302] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6828d7ec451e42c6a9f5e8cd710dfbd2; no voters:
I20260807 22:47:39.769562 15290 leader_election.cc:288] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:39.769682 15295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:39.769955 15295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [term 1 LEADER]: Becoming Leader. State: Replica: 6828d7ec451e42c6a9f5e8cd710dfbd2, State: Running, Role: LEADER
I20260807 22:47:39.770339 15295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 40535 } }
I20260807 22:47:39.770903 15290 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:39.772186 15296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 40535 } } }
I20260807 22:47:39.772194 15297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6828d7ec451e42c6a9f5e8cd710dfbd2. Latest consensus state: current_term: 1 leader_uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6828d7ec451e42c6a9f5e8cd710dfbd2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 40535 } } }
I20260807 22:47:39.772358 15296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:39.772401 15297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:39.772765 15305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:39.775419 15305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:39.780454 15305 catalog_manager.cc:1347] Generated new cluster ID: 43e8c40b533843b285ad48306040ced3
I20260807 22:47:39.780519 15305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:39.787899 15305 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:39.789059 15305 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:39.812247 15305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6828d7ec451e42c6a9f5e8cd710dfbd2: Generated new TSK 0
I20260807 22:47:39.812996 15305 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:47:39.847807 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:40535
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:39.958786 15316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:39.959095 15316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:39.959172 15316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:39.963145 15316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:39.963234 15316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:39.963325 15316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:39.968549 15316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:40535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:39.969609 15316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:39.970733 15316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:39.980501 15322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:39.980549 15321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:39.980518 15324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:39.980757 15316 server_base.cc:1034] running on GCE node
I20260807 22:47:39.981110 15316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:39.981725 15316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:39.982888 15316 hybrid_clock.cc:648] HybridClock initialized: now 1786142859982861 us; error 40 us; skew 500 ppm
Aug 07 22:47:39 dist-test-slave-tm1g krb5kdc[15207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142859, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:39.985785 15316 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:47:39.986706 15316 webserver.cc:460] Webserver started at http://127.12.112.193:43343/ using document root <none> and password file <none>
I20260807 22:47:39.987267 15316 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:39.987329 15316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:39.987550 15316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:39.989630 15316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "7d412d87c6b341969c032e970d9668b6"
format_stamp: "Formatted at 2026-08-07 22:47:39 on dist-test-slave-tm1g"
server_key: "d319c02fe1e8c7df8a720c8400126018"
server_key_iv: "b9b3b1062549a4eb5203238b1b215bf4"
server_key_version: "encryptionkey@0"
I20260807 22:47:39.990198 15316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "7d412d87c6b341969c032e970d9668b6"
format_stamp: "Formatted at 2026-08-07 22:47:39 on dist-test-slave-tm1g"
server_key: "d319c02fe1e8c7df8a720c8400126018"
server_key_iv: "b9b3b1062549a4eb5203238b1b215bf4"
server_key_version: "encryptionkey@0"
I20260807 22:47:39.994014 15316 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260807 22:47:39.996505 15331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:39.997812 15316 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:39.997963 15316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "7d412d87c6b341969c032e970d9668b6"
format_stamp: "Formatted at 2026-08-07 22:47:39 on dist-test-slave-tm1g"
server_key: "d319c02fe1e8c7df8a720c8400126018"
server_key_iv: "b9b3b1062549a4eb5203238b1b215bf4"
server_key_version: "encryptionkey@0"
I20260807 22:47:39.998075 15316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:40.016281 15316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:40.019650 15316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:40.019876 15316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:40.020506 15316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:40.021390 15316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:40.021457 15316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:40.021526 15316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:40.021565 15316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:40.030423 15316 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:38905
I20260807 22:47:40.030447 15450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:38905 every 8 connection(s)
I20260807 22:47:40.031329 15316 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:40.034693 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 15316
I20260807 22:47:40.034783 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:40.035049 12739 external_mini_cluster.cc:1428] Setting key f933ea05cbc2edf5a05826ae2a384a32
Aug 07 22:47:40 dist-test-slave-tm1g krb5kdc[15207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142859, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:47:40.046362 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:40.033093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:32853 (local address 127.12.112.254:40535)
0807 22:47:40.033233 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:40.033237 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:40.034278 (+ 1041us) server_negotiation.cc:407] Connection header received
0807 22:47:40.035322 (+ 1044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:40.035326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:40.035409 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:40.035508 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:40.036692 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.037232 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.038616 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.038865 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.038952 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:40.041969 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:40.041975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:40.041982 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:40.042022 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:40.043811 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:40.044315 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:40.044321 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:40.044326 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:40.044425 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:40.044769 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:40.044772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:40.044774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:40.045053 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:40.045164 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:40.045910 (+ 746us) server_negotiation.cc:299] Negotiation successful
0807 22:47:40.046083 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:47:40.047241 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:40.033463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:40535 (local address 127.12.112.193:32853)
0807 22:47:40.034123 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:40.034166 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:40.035102 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:40.035693 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:40.035699 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:40.036058 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:40.036540 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:40.036553 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.037357 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.037361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:40.038491 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:40.038506 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.039023 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.039029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:40.039254 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:40.040019 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:40.040035 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:40.041775 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:40.043936 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:40.043941 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:40.043954 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:40.044209 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:40.044522 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:40.044524 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:40.044525 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:40.044673 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:40.045207 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:40.045216 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:40.045602 (+ 386us) client_negotiation.cc:769] Sending connection context
0807 22:47:40.045853 (+ 251us) client_negotiation.cc:240] Negotiation successful
0807 22:47:40.046254 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":114,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:47:40.048614 15451 heartbeater.cc:347] Connected to a master server at 127.12.112.254:40535
I20260807 22:47:40.049000 15451 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:40.049585 15451 heartbeater.cc:511] Master 127.12.112.254:40535 requested a full tablet report, sending...
I20260807 22:47:40.051378 15245 ts_manager.cc:194] Registered new tserver with Master: 7d412d87c6b341969c032e970d9668b6 (127.12.112.193:38905)
I20260807 22:47:40.053135 15245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:32853
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:47:40.064700 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:40535
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:40.176404 15456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:40.176663 15456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:40.176707 15456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:40.180837 15456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:40.180905 15456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:40.180996 15456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:40.186436 15456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:40535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:40.187529 15456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:40.188568 15456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:47:40.198251 15456 server_base.cc:1034] running on GCE node
W20260807 22:47:40.198227 15462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:40.198223 15464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:40.198199 15461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:40.198906 15456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:40.199481 15456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:40.200636 15456 hybrid_clock.cc:648] HybridClock initialized: now 1786142860200618 us; error 29 us; skew 500 ppm
Aug 07 22:47:40 dist-test-slave-tm1g krb5kdc[15207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:40.203547 15456 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:47:40.204391 15456 webserver.cc:460] Webserver started at http://127.12.112.194:42209/ using document root <none> and password file <none>
I20260807 22:47:40.204890 15456 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:40.204948 15456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:40.205112 15456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:40.207136 15456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "c4492732292d446c93db8c5ee8cad86c"
format_stamp: "Formatted at 2026-08-07 22:47:40 on dist-test-slave-tm1g"
server_key: "90b0edece0a45b64f7814c0703f20db9"
server_key_iv: "32254b228bce572fd0f9de4b8b336abe"
server_key_version: "encryptionkey@0"
I20260807 22:47:40.207650 15456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "c4492732292d446c93db8c5ee8cad86c"
format_stamp: "Formatted at 2026-08-07 22:47:40 on dist-test-slave-tm1g"
server_key: "90b0edece0a45b64f7814c0703f20db9"
server_key_iv: "32254b228bce572fd0f9de4b8b336abe"
server_key_version: "encryptionkey@0"
I20260807 22:47:40.211215 15456 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:47:40.213467 15472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:40.214675 15456 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:40.214802 15456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "c4492732292d446c93db8c5ee8cad86c"
format_stamp: "Formatted at 2026-08-07 22:47:40 on dist-test-slave-tm1g"
server_key: "90b0edece0a45b64f7814c0703f20db9"
server_key_iv: "32254b228bce572fd0f9de4b8b336abe"
server_key_version: "encryptionkey@0"
I20260807 22:47:40.214907 15456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:40.224192 15456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:40.226938 15456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:40.227133 15456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:40.227694 15456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:40.228482 15456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:40.228549 15456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:40.228619 15456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:40.228659 15456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:40.237540 15456 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:43433
I20260807 22:47:40.237571 15587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:43433 every 8 connection(s)
I20260807 22:47:40.238442 15456 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:40.241071 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 15456
I20260807 22:47:40.241189 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:40.241494 12739 external_mini_cluster.cc:1428] Setting key ba9ac7c6ca8e714eddab662d29d82793
Aug 07 22:47:40 dist-test-slave-tm1g krb5kdc[15207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:47:40.252753 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:40.240178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:46567 (local address 127.12.112.254:40535)
0807 22:47:40.240323 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:40.240327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:40.241414 (+ 1087us) server_negotiation.cc:407] Connection header received
0807 22:47:40.242516 (+ 1102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:40.242519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:40.242577 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:40.242673 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:40.243894 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.244440 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.245679 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.245929 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.246044 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:40.248972 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:40.248975 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:40.248977 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:40.249002 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:40.250470 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:40.251068 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:40.251071 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:40.251072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:40.251145 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:40.251550 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:40.251552 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:40.251553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:40.251724 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:40.251799 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:40.252519 (+ 720us) server_negotiation.cc:299] Negotiation successful
0807 22:47:40.252625 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:47:40.253729 15591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:40.240559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:40535 (local address 127.12.112.194:46567)
0807 22:47:40.241266 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:40.241317 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:40.242264 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:40.242850 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:40.242860 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:40.243268 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:40.243744 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:40.243756 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.244567 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.244571 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:40.245554 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:40.245563 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.246094 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.246097 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:40.246244 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:40.246917 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:40.246933 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:40.248794 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:40.250585 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:40.250594 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:40.250612 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:40.250971 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:40.251239 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:40.251244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:40.251249 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:40.251459 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:40.251832 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:40.251838 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:40.252168 (+ 330us) client_negotiation.cc:769] Sending connection context
0807 22:47:40.252494 (+ 326us) client_negotiation.cc:240] Negotiation successful
0807 22:47:40.252822 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":118,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:47:40.255017 15588 heartbeater.cc:347] Connected to a master server at 127.12.112.254:40535
I20260807 22:47:40.255308 15588 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:40.255810 15588 heartbeater.cc:511] Master 127.12.112.254:40535 requested a full tablet report, sending...
I20260807 22:47:40.256814 15245 ts_manager.cc:194] Registered new tserver with Master: c4492732292d446c93db8c5ee8cad86c (127.12.112.194:43433)
I20260807 22:47:40.257386 15245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:46567
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:47:40.271811 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:40535
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:40.385751 15594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:40.386039 15594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:40.386085 15594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:40.390136 15594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:40.390206 15594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:40.390264 15594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:40.396319 15594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:40535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:40.397317 15594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:40.398260 15594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:40.408113 15600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:40.408103 15599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:40.408157 15602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:40.408726 15594 server_base.cc:1034] running on GCE node
I20260807 22:47:40.409180 15594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:40.410000 15594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:40.411171 15594 hybrid_clock.cc:648] HybridClock initialized: now 1786142860411153 us; error 37 us; skew 500 ppm
Aug 07 22:47:40 dist-test-slave-tm1g krb5kdc[15207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:40.413883 15594 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:47:40.414803 15594 webserver.cc:460] Webserver started at http://127.12.112.195:45789/ using document root <none> and password file <none>
I20260807 22:47:40.415333 15594 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:40.415397 15594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:40.415570 15594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:40.417655 15594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "6632a2c510de44acabea84b46072d149"
format_stamp: "Formatted at 2026-08-07 22:47:40 on dist-test-slave-tm1g"
server_key: "3498055abc0548a52818d2736ba1f53c"
server_key_iv: "ac3c42cf952f371a8f3182e01c8748a9"
server_key_version: "encryptionkey@0"
I20260807 22:47:40.418239 15594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "6632a2c510de44acabea84b46072d149"
format_stamp: "Formatted at 2026-08-07 22:47:40 on dist-test-slave-tm1g"
server_key: "3498055abc0548a52818d2736ba1f53c"
server_key_iv: "ac3c42cf952f371a8f3182e01c8748a9"
server_key_version: "encryptionkey@0"
I20260807 22:47:40.422051 15594 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:47:40.424516 15609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:40.425727 15594 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:47:40.425868 15594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "6632a2c510de44acabea84b46072d149"
format_stamp: "Formatted at 2026-08-07 22:47:40 on dist-test-slave-tm1g"
server_key: "3498055abc0548a52818d2736ba1f53c"
server_key_iv: "ac3c42cf952f371a8f3182e01c8748a9"
server_key_version: "encryptionkey@0"
I20260807 22:47:40.425985 15594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:40.453893 15594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:40.457252 15594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:40.457469 15594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:40.458077 15594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:40.458995 15594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:40.459060 15594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:40.459131 15594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:40.459170 15594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:40.468241 15594 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:45335
I20260807 22:47:40.468263 15724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:45335 every 8 connection(s)
I20260807 22:47:40.469206 15594 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:47:40 dist-test-slave-tm1g krb5kdc[15207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142860, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:40.479133 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 15594
I20260807 22:47:40.479270 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:47:40.479635 12739 external_mini_cluster.cc:1428] Setting key 1eb22f70962f628f0232f859418bdf16
I20260807 22:47:40.483124 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:40.471032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:40233 (local address 127.12.112.254:40535)
0807 22:47:40.471228 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:40.471233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:40.472354 (+ 1121us) server_negotiation.cc:407] Connection header received
0807 22:47:40.473362 (+ 1008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:40.473364 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:40.473412 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:40.473485 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:40.474696 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.475242 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.476421 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.476643 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.476720 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:40.479248 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:40.479252 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:40.479256 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:40.479289 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:40.481008 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:40.481600 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:40.481603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:40.481604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:40.481680 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:40.482016 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:40.482020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:40.482021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:40.482214 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:40.482291 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:40.482895 (+ 604us) server_negotiation.cc:299] Negotiation successful
0807 22:47:40.483003 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:47:40.483963 15727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:40.471455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:40535 (local address 127.12.112.195:40233)
0807 22:47:40.472206 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:40.472250 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:40.473152 (+ 902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:40.473639 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:40.473645 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:40.474007 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:40.474540 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:40.474553 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.475363 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.475365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:40.476310 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:40.476319 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:40.476781 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:40.476784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:40.476934 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:40.477507 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:40.477523 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:40.479070 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:40.481110 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:40.481114 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:40.481143 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:40.481510 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:40.481774 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:40.481776 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:40.481780 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:40.481927 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:40.482335 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:40.482344 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:40.482609 (+ 265us) client_negotiation.cc:769] Sending connection context
0807 22:47:40.482780 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 22:47:40.483042 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":121,"threads_started":1}
I20260807 22:47:40.485059 15725 heartbeater.cc:347] Connected to a master server at 127.12.112.254:40535
I20260807 22:47:40.485314 15725 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:40.485811 15725 heartbeater.cc:511] Master 127.12.112.254:40535 requested a full tablet report, sending...
I20260807 22:47:40.486847 15245 ts_manager.cc:194] Registered new tserver with Master: 6632a2c510de44acabea84b46072d149 (127.12.112.195:45335)
I20260807 22:47:40.487429 15245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:40233
I20260807 22:47:40.493906 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 22:47:40.509011 15293 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:47:40.507651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57926 (local address 127.12.112.254:40535)
0807 22:47:40.507786 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:40.507790 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:40.507911 (+ 121us) server_negotiation.cc:407] Connection header received
0807 22:47:40.507996 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:40.507999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:40.508047 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:40.508130 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:40.508884 (+ 754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57926: BlockingRecv error: recv got EOF from 127.0.0.1:57926 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:47:40.510107 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 15316
I20260807 22:47:40.517825 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 15456
I20260807 22:47:40.524816 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 15594
I20260807 22:47:40.531898 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 15220
2026-08-07T22:47:40Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2219 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:40 dist-test-slave-tm1g krb5kdc[15738](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:40 dist-test-slave-tm1g krb5kdc[15738](info): set up 2 sockets
Aug 07 22:47:40 dist-test-slave-tm1g krb5kdc[15738](info): commencing operation
krb5kdc: starting...
W20260807 22:47:41.602144 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:41 dist-test-slave-tm1g krb5kdc[15738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:47:41.729527 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:32815
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:42301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:32815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:41.846905 15751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:41.847199 15751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:41.847280 15751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:41.851369 15751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:41.851450 15751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:41.851490 15751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:41.851549 15751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:41.851589 15751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:41.856904 15751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:42301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:32815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:32815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:41.857988 15751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:41.859030 15751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:41.867558 15759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:41.867563 15757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:41.867664 15751 server_base.cc:1034] running on GCE node
W20260807 22:47:41.867601 15756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:41.868409 15751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:41.869493 15751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:41.870693 15751 hybrid_clock.cc:648] HybridClock initialized: now 1786142861870675 us; error 30 us; skew 500 ppm
Aug 07 22:47:41 dist-test-slave-tm1g krb5kdc[15738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142861, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:41.878724 15751 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:47:41.879685 15751 webserver.cc:460] Webserver started at http://127.12.112.254:44911/ using document root <none> and password file <none>
I20260807 22:47:41.880290 15751 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:41.880390 15751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:41.880626 15751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:41.882830 15751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "9f4ad012bffc42cc8a95a875dbcbe33e"
format_stamp: "Formatted at 2026-08-07 22:47:41 on dist-test-slave-tm1g"
server_key: "6667d0c46181dd736cb27b5b2f9361bf"
server_key_iv: "37dfbef2d0d33908737f491819a83d25"
server_key_version: "encryptionkey@0"
I20260807 22:47:41.883599 15751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "9f4ad012bffc42cc8a95a875dbcbe33e"
format_stamp: "Formatted at 2026-08-07 22:47:41 on dist-test-slave-tm1g"
server_key: "6667d0c46181dd736cb27b5b2f9361bf"
server_key_iv: "37dfbef2d0d33908737f491819a83d25"
server_key_version: "encryptionkey@0"
I20260807 22:47:41.887478 15751 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260807 22:47:41.889870 15766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:41.891352 15751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:47:41.891535 15751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "9f4ad012bffc42cc8a95a875dbcbe33e"
format_stamp: "Formatted at 2026-08-07 22:47:41 on dist-test-slave-tm1g"
server_key: "6667d0c46181dd736cb27b5b2f9361bf"
server_key_iv: "37dfbef2d0d33908737f491819a83d25"
server_key_version: "encryptionkey@0"
I20260807 22:47:41.891664 15751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:41.909945 15751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:41.912767 15751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:41.912978 15751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:41.920739 15751 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:32815
I20260807 22:47:41.921038 15819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:32815 every 8 connection(s)
I20260807 22:47:41.921768 15751 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:41.924625 15820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:41.926775 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 15751
I20260807 22:47:41.926898 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:41.927168 12739 external_mini_cluster.cc:1428] Setting key 4c4dfaee4babf7594698517105b94b95
I20260807 22:47:41.930661 15820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e: Bootstrap starting.
I20260807 22:47:41.932825 15820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:41.933573 15820 log.cc:824] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:41.935452 15820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e: No bootstrap required, opened a new log
Aug 07 22:47:41 dist-test-slave-tm1g krb5kdc[15738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:41.938745 15820 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f4ad012bffc42cc8a95a875dbcbe33e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 32815 } }
I20260807 22:47:41.939002 15820 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:41.939081 15820 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4ad012bffc42cc8a95a875dbcbe33e, State: Initialized, Role: FOLLOWER
I20260807 22:47:41.939596 15820 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f4ad012bffc42cc8a95a875dbcbe33e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 32815 } }
I20260807 22:47:41.939782 15820 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:41.939888 15820 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:41.939993 15820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:41.941059 15820 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f4ad012bffc42cc8a95a875dbcbe33e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 32815 } }
I20260807 22:47:41.941435 15820 leader_election.cc:302] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f4ad012bffc42cc8a95a875dbcbe33e; no voters:
I20260807 22:47:41.941771 15820 leader_election.cc:288] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:41.941879 15825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:41.942088 15825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [term 1 LEADER]: Becoming Leader. State: Replica: 9f4ad012bffc42cc8a95a875dbcbe33e, State: Running, Role: LEADER
I20260807 22:47:41.942379 15823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:41.928521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46894 (local address 127.12.112.254:32815)
0807 22:47:41.928975 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:41.928994 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:41.929029 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:47:41.929778 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:41.929796 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:41.930132 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:41.930500 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:41.931363 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:41.932350 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:41.933322 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:41.933850 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:41.934036 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:41.936788 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:41.936793 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:41.936806 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:41.936833 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:41.939236 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:41.939722 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:41.939726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:41.939731 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:41.939896 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:41.940221 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:41.940223 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:41.940225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:41.940610 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:41.940764 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:41.941079 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 22:47:41.941376 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":138,"threads_started":1}
I20260807 22:47:41.942508 15825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f4ad012bffc42cc8a95a875dbcbe33e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 32815 } }
I20260807 22:47:41.943120 15820 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:41.945027 15826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f4ad012bffc42cc8a95a875dbcbe33e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f4ad012bffc42cc8a95a875dbcbe33e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 32815 } } }
I20260807 22:47:41.945143 15826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:41.945519 15827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f4ad012bffc42cc8a95a875dbcbe33e. Latest consensus state: current_term: 1 leader_uuid: "9f4ad012bffc42cc8a95a875dbcbe33e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f4ad012bffc42cc8a95a875dbcbe33e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 32815 } } }
I20260807 22:47:41.945827 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:47:41.945672 15827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e [sys.catalog]: This master's current role is: LEADER
W20260807 22:47:41.948463 15843 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:47:41.948544 15843 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:47:41.948611 15841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:41.949290 15841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:41.955236 15841 catalog_manager.cc:1347] Generated new cluster ID: b15782e806544a189ebc5045468967d3
I20260807 22:47:41.955298 15841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:41.967440 15823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:41.961804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46910 (local address 127.12.112.254:32815)
0807 22:47:41.961920 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:41.961925 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:41.962106 (+ 181us) server_negotiation.cc:407] Connection header received
0807 22:47:41.962227 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:41.962231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:41.962280 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:41.962400 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:41.962977 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:41.963830 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:41.964956 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:41.965340 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:41.965453 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:41.966368 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:41.966371 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:41.966374 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:41.966962 (+ 588us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:41.966998 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:41.967017 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:41.967109 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:41.967212 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 22:47:41.967277 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:47:41.971014 15841 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:41.973151 15841 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:41.986214 15841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f4ad012bffc42cc8a95a875dbcbe33e: Generated new TSK 0
I20260807 22:47:41.987075 15841 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:47:41.993734 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 15751
2026-08-07T22:47:41Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1459 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:42 dist-test-slave-tm1g krb5kdc[15855](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:42 dist-test-slave-tm1g krb5kdc[15855](info): set up 2 sockets
Aug 07 22:47:42 dist-test-slave-tm1g krb5kdc[15855](info): commencing operation
krb5kdc: starting...
W20260807 22:47:43.068429 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:43 dist-test-slave-tm1g krb5kdc[15855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:47:43.193886 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:37719
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:37657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:37719
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:43.304324 15868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:43.304662 15868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:43.304738 15868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:43.308777 15868 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:43.308883 15868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:43.308923 15868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:43.308961 15868 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:43.308995 15868 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:43.314445 15868 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:37657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:37719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:37719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:43.315685 15868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:43.316758 15868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:43.325511 15874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:43.325485 15873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:43.325510 15876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:43.325659 15868 server_base.cc:1034] running on GCE node
I20260807 22:47:43.326292 15868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:43.327432 15868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:43.328596 15868 hybrid_clock.cc:648] HybridClock initialized: now 1786142863328584 us; error 26 us; skew 500 ppm
Aug 07 22:47:43 dist-test-slave-tm1g krb5kdc[15855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142863, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:43.331481 15868 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:47:43.332418 15868 webserver.cc:460] Webserver started at http://127.12.112.254:37805/ using document root <none> and password file <none>
I20260807 22:47:43.332974 15868 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:43.333037 15868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:43.333253 15868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:43.335393 15868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "74cbe9c6c2e14379bd3a44838a283f59"
format_stamp: "Formatted at 2026-08-07 22:47:43 on dist-test-slave-tm1g"
server_key: "be815df3c187a450bd34f6c0c6849f1a"
server_key_iv: "233d3e8c96eb1e05f4736c5900c08065"
server_key_version: "encryptionkey@0"
I20260807 22:47:43.335978 15868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "74cbe9c6c2e14379bd3a44838a283f59"
format_stamp: "Formatted at 2026-08-07 22:47:43 on dist-test-slave-tm1g"
server_key: "be815df3c187a450bd34f6c0c6849f1a"
server_key_iv: "233d3e8c96eb1e05f4736c5900c08065"
server_key_version: "encryptionkey@0"
I20260807 22:47:43.339726 15868 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:47:43.342154 15884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:43.343405 15868 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:43.343549 15868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "74cbe9c6c2e14379bd3a44838a283f59"
format_stamp: "Formatted at 2026-08-07 22:47:43 on dist-test-slave-tm1g"
server_key: "be815df3c187a450bd34f6c0c6849f1a"
server_key_iv: "233d3e8c96eb1e05f4736c5900c08065"
server_key_version: "encryptionkey@0"
I20260807 22:47:43.343663 15868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:43.365113 15868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:43.368594 15868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:43.368808 15868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:43.376284 15868 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:37719
I20260807 22:47:43.376624 15936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:37719 every 8 connection(s)
I20260807 22:47:43.377300 15868 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:43.380245 15937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:43.380816 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 15868
I20260807 22:47:43.380942 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:43.381263 12739 external_mini_cluster.cc:1428] Setting key 94ab77d9ebad8e7a971edceaecaeb530
I20260807 22:47:43.387264 15937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59: Bootstrap starting.
I20260807 22:47:43.389918 15937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:43.390738 15937 log.cc:824] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:47:43 dist-test-slave-tm1g krb5kdc[15855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:43.393222 15937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59: No bootstrap required, opened a new log
I20260807 22:47:43.397058 15940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:43.382792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41122 (local address 127.12.112.254:37719)
0807 22:47:43.383227 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:43.383245 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:43.383289 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:47:43.384129 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:43.384151 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:43.384563 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:43.384932 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:43.385659 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:43.387190 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:43.388117 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:43.388834 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:43.389000 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:43.391708 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:43.391715 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:43.391732 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:43.391760 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:43.393782 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:43.394252 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:43.394257 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:43.394263 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:43.394434 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:43.394730 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:43.394734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:43.394736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:43.395286 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:43.395516 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:43.395758 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 22:47:43.396078 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":114,"threads_started":1}
I20260807 22:47:43.397892 15937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74cbe9c6c2e14379bd3a44838a283f59" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37719 } }
I20260807 22:47:43.398164 15937 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:43.398276 15937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74cbe9c6c2e14379bd3a44838a283f59, State: Initialized, Role: FOLLOWER
I20260807 22:47:43.398778 15937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74cbe9c6c2e14379bd3a44838a283f59" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37719 } }
I20260807 22:47:43.398938 15937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:43.399020 15937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:43.399120 15937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:43.400128 15937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74cbe9c6c2e14379bd3a44838a283f59" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37719 } }
I20260807 22:47:43.400480 15937 leader_election.cc:302] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74cbe9c6c2e14379bd3a44838a283f59; no voters:
I20260807 22:47:43.400837 15937 leader_election.cc:288] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:43.400938 15942 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:43.401144 15942 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [term 1 LEADER]: Becoming Leader. State: Replica: 74cbe9c6c2e14379bd3a44838a283f59, State: Running, Role: LEADER
I20260807 22:47:43.401466 15942 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74cbe9c6c2e14379bd3a44838a283f59" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37719 } }
I20260807 22:47:43.402128 15937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:43.403496 15944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74cbe9c6c2e14379bd3a44838a283f59. Latest consensus state: current_term: 1 leader_uuid: "74cbe9c6c2e14379bd3a44838a283f59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74cbe9c6c2e14379bd3a44838a283f59" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37719 } } }
I20260807 22:47:43.403667 15944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:43.403491 15943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74cbe9c6c2e14379bd3a44838a283f59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74cbe9c6c2e14379bd3a44838a283f59" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37719 } } }
I20260807 22:47:43.404062 15943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59 [sys.catalog]: This master's current role is: LEADER
W20260807 22:47:43.407387 15957 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:47:43.407454 15957 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:47:43.407534 15952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:43.408192 15952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:43.413558 15952 catalog_manager.cc:1347] Generated new cluster ID: 4382cca6a660448b9627045db33d2ff1
I20260807 22:47:43.413622 15952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:43.428965 15952 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:43.429879 15952 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:43.439150 15952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74cbe9c6c2e14379bd3a44838a283f59: Generated new TSK 0
I20260807 22:47:43.439833 15952 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:47:43.473816 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37719
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:37657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:43.587129 15963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:43.587432 15963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:43.587523 15963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:43.591639 15963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:43.591720 15963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:43.591811 15963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:43.596973 15963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:37657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:43.598039 15963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:43.599124 15963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:47:43.609126 15963 server_base.cc:1034] running on GCE node
W20260807 22:47:43.609077 15972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:43.609074 15968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:43.609074 15970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:43.609782 15963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:43.610560 15963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:43.611718 15963 hybrid_clock.cc:648] HybridClock initialized: now 1786142863611693 us; error 40 us; skew 500 ppm
Aug 07 22:47:43 dist-test-slave-tm1g krb5kdc[15855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142863, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:43.614514 15963 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:47:43.615401 15963 webserver.cc:460] Webserver started at http://127.12.112.193:33571/ using document root <none> and password file <none>
I20260807 22:47:43.615962 15963 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:43.616022 15963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:43.616183 15963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:43.618139 15963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "356edf36be38488cab2b03e39060b9e2"
format_stamp: "Formatted at 2026-08-07 22:47:43 on dist-test-slave-tm1g"
server_key: "612f3b28e7958fce96a0cc91b675a36a"
server_key_iv: "be7ec4d8bf9504b0be974d1055fb1cf2"
server_key_version: "encryptionkey@0"
I20260807 22:47:43.618719 15963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "356edf36be38488cab2b03e39060b9e2"
format_stamp: "Formatted at 2026-08-07 22:47:43 on dist-test-slave-tm1g"
server_key: "612f3b28e7958fce96a0cc91b675a36a"
server_key_iv: "be7ec4d8bf9504b0be974d1055fb1cf2"
server_key_version: "encryptionkey@0"
I20260807 22:47:43.622596 15963 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:47:43.624832 15979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:43.626066 15963 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:43.626204 15963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "356edf36be38488cab2b03e39060b9e2"
format_stamp: "Formatted at 2026-08-07 22:47:43 on dist-test-slave-tm1g"
server_key: "612f3b28e7958fce96a0cc91b675a36a"
server_key_iv: "be7ec4d8bf9504b0be974d1055fb1cf2"
server_key_version: "encryptionkey@0"
I20260807 22:47:43.626372 15963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:43.643121 15963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:43.646281 15963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:43.646474 15963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:43.647004 15963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:43.647864 15963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:43.647914 15963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:43.647954 15963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:43.647969 15963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:43.657227 15963 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:42321
I20260807 22:47:43.657248 16096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:42321 every 8 connection(s)
I20260807 22:47:43.658098 15963 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:43.661064 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 15963
I20260807 22:47:43.661198 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:43.661578 12739 external_mini_cluster.cc:1428] Setting key 4b051102cdbfa5e4bc8ae6bb9c5f8940
Aug 07 22:47:43 dist-test-slave-tm1g krb5kdc[15855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142863, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:47:43.673102 15940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:43.659887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:44575 (local address 127.12.112.254:37719)
0807 22:47:43.660032 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:43.660037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:43.660958 (+ 921us) server_negotiation.cc:407] Connection header received
0807 22:47:43.662692 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:43.662695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:43.662748 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:43.662829 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:43.664383 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:43.664919 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:43.666106 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:43.666415 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:43.666528 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:43.669406 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:43.669409 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:43.669411 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:43.669435 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:43.670913 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:43.671538 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:43.671540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:43.671542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:43.671613 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:43.672015 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:43.672017 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:43.672018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:43.672184 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:43.672292 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:43.672876 (+ 584us) server_negotiation.cc:299] Negotiation successful
0807 22:47:43.672979 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:47:43.674000 16099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:43.660314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37719 (local address 127.12.112.193:44575)
0807 22:47:43.660753 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:43.660838 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:43.662493 (+ 1655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:43.662997 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:43.663004 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:43.663506 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:43.664206 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:43.664227 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:43.665063 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:43.665067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:43.665975 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:43.665985 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:43.666571 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:43.666575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:43.666746 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:43.667369 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:43.667388 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:43.669227 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:43.671038 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:43.671047 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:43.671067 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:43.671439 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:43.671713 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:43.671718 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:43.671722 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:43.671918 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:43.672317 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:43.672327 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:43.672648 (+ 321us) client_negotiation.cc:769] Sending connection context
0807 22:47:43.672821 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 22:47:43.673091 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":105,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:47:43.675506 16097 heartbeater.cc:347] Connected to a master server at 127.12.112.254:37719
I20260807 22:47:43.675765 16097 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:43.676260 16097 heartbeater.cc:511] Master 127.12.112.254:37719 requested a full tablet report, sending...
I20260807 22:47:43.677785 15901 ts_manager.cc:194] Registered new tserver with Master: 356edf36be38488cab2b03e39060b9e2 (127.12.112.193:42321)
I20260807 22:47:43.678983 15901 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:44575
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:47:43.691150 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37719
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:37657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:43.805912 16102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:43.806198 16102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:43.806274 16102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:43.810279 16102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:43.810424 16102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:43.810523 16102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:43.815876 16102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:37657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:43.816959 16102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:43.817992 16102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:43.827497 16108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:43.827562 16102 server_base.cc:1034] running on GCE node
W20260807 22:47:43.827487 16107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:43.827486 16110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:43.828224 16102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:43.828895 16102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:43.830132 16102 hybrid_clock.cc:648] HybridClock initialized: now 1786142863830083 us; error 56 us; skew 500 ppm
Aug 07 22:47:43 dist-test-slave-tm1g krb5kdc[15855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142863, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:43.832933 16102 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:47:43.833712 16102 webserver.cc:460] Webserver started at http://127.12.112.194:38009/ using document root <none> and password file <none>
I20260807 22:47:43.834229 16102 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:43.834285 16102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:43.834523 16102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:43.837067 16102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "1931dcc961ce4d27afb7952736b46927"
format_stamp: "Formatted at 2026-08-07 22:47:43 on dist-test-slave-tm1g"
server_key: "20904759548a3f6068895e267f0cc4a0"
server_key_iv: "0a60eb1d091cbf2f9753e3266760d60f"
server_key_version: "encryptionkey@0"
I20260807 22:47:43.837577 16102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "1931dcc961ce4d27afb7952736b46927"
format_stamp: "Formatted at 2026-08-07 22:47:43 on dist-test-slave-tm1g"
server_key: "20904759548a3f6068895e267f0cc4a0"
server_key_iv: "0a60eb1d091cbf2f9753e3266760d60f"
server_key_version: "encryptionkey@0"
I20260807 22:47:43.841166 16102 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:47:43.843497 16117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:43.844693 16102 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:43.844794 16102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "1931dcc961ce4d27afb7952736b46927"
format_stamp: "Formatted at 2026-08-07 22:47:43 on dist-test-slave-tm1g"
server_key: "20904759548a3f6068895e267f0cc4a0"
server_key_iv: "0a60eb1d091cbf2f9753e3266760d60f"
server_key_version: "encryptionkey@0"
I20260807 22:47:43.844877 16102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:43.890116 16102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:43.893407 16102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:43.893566 16102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:43.894111 16102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:43.894971 16102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:43.895016 16102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:43.895057 16102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:43.895072 16102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:43.904219 16102 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:43997
I20260807 22:47:43.904273 16235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:43997 every 8 connection(s)
I20260807 22:47:43.905121 16102 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:43.908267 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 16102
I20260807 22:47:43.908416 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:43.908766 12739 external_mini_cluster.cc:1428] Setting key 0aba6d737ea0154a42a3740c5526ee8a
Aug 07 22:47:43 dist-test-slave-tm1g krb5kdc[15855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142863, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:47:43.920818 15940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:43.906943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:38665 (local address 127.12.112.254:37719)
0807 22:47:43.907077 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:43.907081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:43.907830 (+ 749us) server_negotiation.cc:407] Connection header received
0807 22:47:43.909553 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:43.909556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:43.909598 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:43.909677 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:43.911180 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:43.911725 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:43.913175 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:43.913583 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:43.913710 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:43.916896 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:43.916899 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:43.916901 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:43.916925 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:43.918596 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:43.919230 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:43.919233 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:43.919234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:43.919316 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:43.919720 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:43.919722 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:43.919723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:43.919939 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:43.920029 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:43.920569 (+ 540us) server_negotiation.cc:299] Negotiation successful
0807 22:47:43.920680 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":47}
I20260807 22:47:43.921690 16238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:43.907251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37719 (local address 127.12.112.194:38665)
0807 22:47:43.907683 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:43.907723 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:43.909351 (+ 1628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:43.909874 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:43.909883 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:43.910350 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:43.911020 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:43.911043 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:43.911889 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:43.911896 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:43.913050 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:43.913060 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:43.913752 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:43.913755 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:43.913930 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:43.914575 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:43.914599 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:43.916703 (+ 2104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:43.918716 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:43.918722 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:43.918737 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:43.919120 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:43.919432 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:43.919435 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:43.919437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:43.919614 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:43.920057 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:43.920066 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:43.920345 (+ 279us) client_negotiation.cc:769] Sending connection context
0807 22:47:43.920513 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 22:47:43.920779 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":106,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:47:43.923020 16236 heartbeater.cc:347] Connected to a master server at 127.12.112.254:37719
I20260807 22:47:43.923273 16236 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:43.923903 16236 heartbeater.cc:511] Master 127.12.112.254:37719 requested a full tablet report, sending...
I20260807 22:47:43.925128 15901 ts_manager.cc:194] Registered new tserver with Master: 1931dcc961ce4d27afb7952736b46927 (127.12.112.194:43997)
I20260807 22:47:43.925722 15901 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:38665
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:47:43.941483 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37719
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:37657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:44.052986 16241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:44.053256 16241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:44.053332 16241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:44.057282 16241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:44.057368 16241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:44.057462 16241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:44.062525 16241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:37657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:44.063560 16241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:44.064586 16241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:44.074275 16246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:44.074400 16249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:44.074319 16247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:44.074522 16241 server_base.cc:1034] running on GCE node
I20260807 22:47:44.075006 16241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:44.075649 16241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:44.076853 16241 hybrid_clock.cc:648] HybridClock initialized: now 1786142864076836 us; error 27 us; skew 500 ppm
Aug 07 22:47:44 dist-test-slave-tm1g krb5kdc[15855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:44.080022 16241 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:47:44.081091 16241 webserver.cc:460] Webserver started at http://127.12.112.195:39529/ using document root <none> and password file <none>
I20260807 22:47:44.081738 16241 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:44.081809 16241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:44.082018 16241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:44.084519 16241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "8c89737fd6a54ecfb92d6e7680360b26"
format_stamp: "Formatted at 2026-08-07 22:47:44 on dist-test-slave-tm1g"
server_key: "06bcc31ccd0d1d0fd45e53473310eb1f"
server_key_iv: "bb60bd887caa2476e24b19f2b5ed19b1"
server_key_version: "encryptionkey@0"
I20260807 22:47:44.085125 16241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "8c89737fd6a54ecfb92d6e7680360b26"
format_stamp: "Formatted at 2026-08-07 22:47:44 on dist-test-slave-tm1g"
server_key: "06bcc31ccd0d1d0fd45e53473310eb1f"
server_key_iv: "bb60bd887caa2476e24b19f2b5ed19b1"
server_key_version: "encryptionkey@0"
I20260807 22:47:44.089440 16241 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 22:47:44.091908 16256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:44.093140 16241 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:44.093286 16241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "8c89737fd6a54ecfb92d6e7680360b26"
format_stamp: "Formatted at 2026-08-07 22:47:44 on dist-test-slave-tm1g"
server_key: "06bcc31ccd0d1d0fd45e53473310eb1f"
server_key_iv: "bb60bd887caa2476e24b19f2b5ed19b1"
server_key_version: "encryptionkey@0"
I20260807 22:47:44.093402 16241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:44.103063 16241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:44.106036 16241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:44.106231 16241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:44.106827 16241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:44.107638 16241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:44.107709 16241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:44.107776 16241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:44.107827 16241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:44.117087 16241 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:45987
I20260807 22:47:44.117115 16375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:45987 every 8 connection(s)
I20260807 22:47:44.117982 16241 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:47:44 dist-test-slave-tm1g krb5kdc[15855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142864, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:44.128008 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 16241
I20260807 22:47:44.128129 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:47:44.128425 12739 external_mini_cluster.cc:1428] Setting key 2c96e936e7273725fe74796d193ac135
I20260807 22:47:44.132385 15940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:44.119835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:54317 (local address 127.12.112.254:37719)
0807 22:47:44.119991 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:44.119995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:44.120798 (+ 803us) server_negotiation.cc:407] Connection header received
0807 22:47:44.122164 (+ 1366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:44.122167 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:44.122215 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:44.122296 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:44.123619 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:44.124143 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:44.125412 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:44.125623 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:44.125705 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:44.128314 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:44.128318 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:44.128320 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:44.128343 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:44.130243 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:44.131016 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:44.131020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:44.131021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:44.131117 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:44.131431 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:44.131434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:44.131435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:44.131616 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:44.131694 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:44.132145 (+ 451us) server_negotiation.cc:299] Negotiation successful
0807 22:47:44.132249 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 22:47:44.133247 16378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:44.120184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37719 (local address 127.12.112.195:54317)
0807 22:47:44.120642 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:44.120684 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:44.121963 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:44.122509 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:44.122515 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:44.122974 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:44.123492 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:44.123507 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:44.124272 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:44.124275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:44.125299 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:44.125311 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:44.125752 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:44.125755 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:44.125901 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:44.126576 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:44.126593 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:44.128097 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:44.130384 (+ 2287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:44.130389 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:44.130405 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:44.130786 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:44.131204 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:44.131206 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:44.131207 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:44.131344 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:44.131704 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:44.131708 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:44.131934 (+ 226us) client_negotiation.cc:769] Sending connection context
0807 22:47:44.132092 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 22:47:44.132341 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":113,"threads_started":1}
I20260807 22:47:44.134377 16376 heartbeater.cc:347] Connected to a master server at 127.12.112.254:37719
I20260807 22:47:44.134621 16376 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:44.135108 16376 heartbeater.cc:511] Master 127.12.112.254:37719 requested a full tablet report, sending...
I20260807 22:47:44.136066 15901 ts_manager.cc:194] Registered new tserver with Master: 8c89737fd6a54ecfb92d6e7680360b26 (127.12.112.195:45987)
I20260807 22:47:44.136627 15901 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:54317
I20260807 22:47:44.142804 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 22:47:44 dist-test-slave-tm1g krb5kdc[15855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142864, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 22:47:44 dist-test-slave-tm1g krb5kdc[15855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142864, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:44.169706 15940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:44.160748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41124 (local address 127.12.112.254:37719)
0807 22:47:44.160958 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:44.160964 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:44.161113 (+ 149us) server_negotiation.cc:407] Connection header received
0807 22:47:44.161342 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:44.161345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:44.161390 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:44.161490 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:44.162244 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:44.162851 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:44.163721 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:44.163949 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:44.164067 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:44.166605 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:44.166608 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:44.166611 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:44.166633 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:44.167943 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:44.168410 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:44.168414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:44.168415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:44.168492 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:44.168775 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:44.168779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:44.168781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:44.169017 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:44.169158 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:44.169414 (+ 256us) server_negotiation.cc:299] Negotiation successful
0807 22:47:44.169533 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
W20260807 22:47:44.170162 15901 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41124
I20260807 22:47:44.171291 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 15963
I20260807 22:47:44.179544 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 16102
I20260807 22:47:44.186919 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 16241
I20260807 22:47:44.193817 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 15868
2026-08-07T22:47:44Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2201 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:44 dist-test-slave-tm1g krb5kdc[16388](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:44 dist-test-slave-tm1g krb5kdc[16388](info): set up 2 sockets
Aug 07 22:47:44 dist-test-slave-tm1g krb5kdc[16388](info): commencing operation
krb5kdc: starting...
W20260807 22:47:45.257871 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:45 dist-test-slave-tm1g krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:47:45.386094 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:39159
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:39159
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:45.505513 16401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:45.505836 16401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:45.505914 16401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:45.509974 16401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:45.510097 16401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:45.510135 16401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:45.510179 16401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:45.510218 16401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:45.515923 16401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:39159
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:39159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:45.517143 16401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:45.518263 16401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:45.527132 16407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:45.527166 16406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:45.527118 16409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:45.527189 16401 server_base.cc:1034] running on GCE node
I20260807 22:47:45.527951 16401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:45.529021 16401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:45.530207 16401 hybrid_clock.cc:648] HybridClock initialized: now 1786142865530185 us; error 39 us; skew 500 ppm
Aug 07 22:47:45 dist-test-slave-tm1g krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142865, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:45.533149 16401 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:47:45.534027 16401 webserver.cc:460] Webserver started at http://127.12.112.254:39851/ using document root <none> and password file <none>
I20260807 22:47:45.534637 16401 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:45.534703 16401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:45.534871 16401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:45.536914 16401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "0c5a1189eb23411aabaee619a7a3c800"
format_stamp: "Formatted at 2026-08-07 22:47:45 on dist-test-slave-tm1g"
server_key: "378d8fb68101b1cb7264ddb1414cbf97"
server_key_iv: "c9890dc63f74a3b9a65719f52f5da813"
server_key_version: "encryptionkey@0"
I20260807 22:47:45.537422 16401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "0c5a1189eb23411aabaee619a7a3c800"
format_stamp: "Formatted at 2026-08-07 22:47:45 on dist-test-slave-tm1g"
server_key: "378d8fb68101b1cb7264ddb1414cbf97"
server_key_iv: "c9890dc63f74a3b9a65719f52f5da813"
server_key_version: "encryptionkey@0"
I20260807 22:47:45.541112 16401 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:47:45.543597 16416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:45.544824 16401 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:45.544924 16401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "0c5a1189eb23411aabaee619a7a3c800"
format_stamp: "Formatted at 2026-08-07 22:47:45 on dist-test-slave-tm1g"
server_key: "378d8fb68101b1cb7264ddb1414cbf97"
server_key_iv: "c9890dc63f74a3b9a65719f52f5da813"
server_key_version: "encryptionkey@0"
I20260807 22:47:45.545008 16401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:45.557636 16401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:45.560669 16401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:45.560823 16401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:45.568114 16401 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:39159
I20260807 22:47:45.568141 16470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:39159 every 8 connection(s)
I20260807 22:47:45.569058 16401 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:45.571837 16471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:45.573328 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 16401
I20260807 22:47:45.573467 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:45.573796 12739 external_mini_cluster.cc:1428] Setting key 1da7a59cab2b9be1584ef79b6b6695bd
I20260807 22:47:45.578501 16471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800: Bootstrap starting.
I20260807 22:47:45.581152 16471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:45.581907 16471 log.cc:824] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:47:45 dist-test-slave-tm1g krb5kdc[16388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:45.584249 16471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800: No bootstrap required, opened a new log
I20260807 22:47:45.588843 16474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:45.575248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54340 (local address 127.12.112.254:39159)
0807 22:47:45.575649 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:45.575671 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:45.575719 (+ 48us) server_negotiation.cc:407] Connection header received
0807 22:47:45.576338 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:45.576354 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:45.576672 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:45.576941 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:45.577883 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:45.578998 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:45.580165 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:45.580631 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:45.580745 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:45.583571 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:45.583577 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:45.583594 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:45.583624 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:45.585585 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:45.586017 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:45.586022 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:45.586028 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:45.586165 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:45.586485 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:45.586488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:45.586489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:45.587090 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:45.587295 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:45.587554 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 22:47:45.587851 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":131,"threads_started":1}
I20260807 22:47:45.589090 16471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5a1189eb23411aabaee619a7a3c800" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39159 } }
I20260807 22:47:45.589358 16471 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:45.589422 16471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5a1189eb23411aabaee619a7a3c800, State: Initialized, Role: FOLLOWER
I20260807 22:47:45.589876 16471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5a1189eb23411aabaee619a7a3c800" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39159 } }
I20260807 22:47:45.590045 16471 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:45.590116 16471 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:45.590212 16471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:45.591324 16471 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5a1189eb23411aabaee619a7a3c800" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39159 } }
I20260807 22:47:45.591661 16471 leader_election.cc:302] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c5a1189eb23411aabaee619a7a3c800; no voters:
I20260807 22:47:45.591975 16471 leader_election.cc:288] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:45.592127 16476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:45.592386 16476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5a1189eb23411aabaee619a7a3c800, State: Running, Role: LEADER
I20260807 22:47:45.592739 16476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5a1189eb23411aabaee619a7a3c800" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39159 } }
I20260807 22:47:45.593220 16471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:45.594424 16477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c5a1189eb23411aabaee619a7a3c800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5a1189eb23411aabaee619a7a3c800" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39159 } } }
I20260807 22:47:45.594558 16477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:45.594928 16485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:45.594916 16478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c5a1189eb23411aabaee619a7a3c800. Latest consensus state: current_term: 1 leader_uuid: "0c5a1189eb23411aabaee619a7a3c800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5a1189eb23411aabaee619a7a3c800" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39159 } } }
I20260807 22:47:45.595672 16478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:45.597716 16485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:45.603427 16485 catalog_manager.cc:1347] Generated new cluster ID: 476c8848b7c34d4283c85c42bfcdfc9b
I20260807 22:47:45.603536 16485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:45.621305 16485 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:45.622709 16485 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:45.631984 16485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c5a1189eb23411aabaee619a7a3c800: Generated new TSK 0
I20260807 22:47:45.632822 16485 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:47:45.665678 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39159
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:45.781629 16498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:45.781885 16498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:45.781929 16498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:45.786048 16498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:45.786118 16498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:45.786195 16498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:45.791711 16498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:45.792816 16498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:45.793968 16498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:45.803715 16503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:45.803716 16504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:45.803709 16506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:45.803833 16498 server_base.cc:1034] running on GCE node
I20260807 22:47:45.804351 16498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:45.804986 16498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:45.806154 16498 hybrid_clock.cc:648] HybridClock initialized: now 1786142865806129 us; error 33 us; skew 500 ppm
Aug 07 22:47:45 dist-test-slave-tm1g krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142865, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:45.808866 16498 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:47:45.809770 16498 webserver.cc:460] Webserver started at http://127.12.112.193:38281/ using document root <none> and password file <none>
I20260807 22:47:45.810405 16498 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:45.810503 16498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:45.810741 16498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:45.813109 16498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "787876ab4aa944bc9891e9d31ca7e609"
format_stamp: "Formatted at 2026-08-07 22:47:45 on dist-test-slave-tm1g"
server_key: "61caa8cc303da1531de5f74e2a40ebbb"
server_key_iv: "e1047c2f9c094f2ce69cbed7cf1562da"
server_key_version: "encryptionkey@0"
I20260807 22:47:45.813700 16498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "787876ab4aa944bc9891e9d31ca7e609"
format_stamp: "Formatted at 2026-08-07 22:47:45 on dist-test-slave-tm1g"
server_key: "61caa8cc303da1531de5f74e2a40ebbb"
server_key_iv: "e1047c2f9c094f2ce69cbed7cf1562da"
server_key_version: "encryptionkey@0"
I20260807 22:47:45.817551 16498 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 22:47:45.820011 16515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:45.821249 16498 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:45.821386 16498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "787876ab4aa944bc9891e9d31ca7e609"
format_stamp: "Formatted at 2026-08-07 22:47:45 on dist-test-slave-tm1g"
server_key: "61caa8cc303da1531de5f74e2a40ebbb"
server_key_iv: "e1047c2f9c094f2ce69cbed7cf1562da"
server_key_version: "encryptionkey@0"
I20260807 22:47:45.821506 16498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:45.844347 16498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:45.847489 16498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:45.847751 16498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:45.848403 16498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:45.849396 16498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:45.849472 16498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:45.849548 16498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:45.849591 16498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:45.858860 16498 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:36993
I20260807 22:47:45.858884 16629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:36993 every 8 connection(s)
I20260807 22:47:45.859777 16498 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:45.862794 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 16498
I20260807 22:47:45.862974 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:45.863291 12739 external_mini_cluster.cc:1428] Setting key 4be082e61a178b7937cfdd64006ac191
Aug 07 22:47:45 dist-test-slave-tm1g krb5kdc[16388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142865, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:47:45.874106 16474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:45.861678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:59433 (local address 127.12.112.254:39159)
0807 22:47:45.861823 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:45.861827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:45.862623 (+ 796us) server_negotiation.cc:407] Connection header received
0807 22:47:45.864260 (+ 1637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:45.864264 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:45.864322 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:45.864432 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:45.865667 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:45.866210 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:45.867385 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:45.867634 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:45.867749 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:45.870284 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:45.870287 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:45.870289 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:45.870352 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:45.871828 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:45.872363 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:45.872367 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:45.872369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:45.872452 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:45.872841 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:45.872845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:45.872847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:45.873050 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:45.873157 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:45.873791 (+ 634us) server_negotiation.cc:299] Negotiation successful
0807 22:47:45.873934 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:47:45.874990 16632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:45.861995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39159 (local address 127.12.112.193:59433)
0807 22:47:45.862452 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:45.862514 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:45.864051 (+ 1537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:45.864608 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:45.864617 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:45.865022 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:45.865516 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:45.865529 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:45.866377 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:45.866379 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:45.867258 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:45.867267 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:45.867789 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:45.867793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:45.867974 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:45.868610 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:45.868627 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:45.870106 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:45.871962 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:45.871967 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:45.871984 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:45.872257 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:45.872545 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:45.872549 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:45.872551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:45.872745 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:45.873157 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:45.873166 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:45.873444 (+ 278us) client_negotiation.cc:769] Sending connection context
0807 22:47:45.873647 (+ 203us) client_negotiation.cc:240] Negotiation successful
0807 22:47:45.873997 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":104,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:47:45.876365 16630 heartbeater.cc:347] Connected to a master server at 127.12.112.254:39159
I20260807 22:47:45.876627 16630 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:45.877152 16630 heartbeater.cc:511] Master 127.12.112.254:39159 requested a full tablet report, sending...
I20260807 22:47:45.878865 16434 ts_manager.cc:194] Registered new tserver with Master: 787876ab4aa944bc9891e9d31ca7e609 (127.12.112.193:36993)
I20260807 22:47:45.880579 16434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:59433
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:47:45.891752 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39159
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:46.005095 16635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:46.005380 16635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:46.005425 16635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:46.009698 16635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:46.009766 16635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:46.009876 16635 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:46.015239 16635 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:46.016335 16635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:46.017374 16635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:46.027212 16643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:46.027199 16640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:46.027274 16641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:46.027555 16635 server_base.cc:1034] running on GCE node
I20260807 22:47:46.028012 16635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:46.028648 16635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:46.029850 16635 hybrid_clock.cc:648] HybridClock initialized: now 1786142866029836 us; error 25 us; skew 500 ppm
Aug 07 22:47:46 dist-test-slave-tm1g krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142866, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:46.032779 16635 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:47:46.033649 16635 webserver.cc:460] Webserver started at http://127.12.112.194:45887/ using document root <none> and password file <none>
I20260807 22:47:46.034224 16635 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:46.034332 16635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:46.034560 16635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:46.036623 16635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "9f22653f54d04e0794fdeb8508bd9827"
format_stamp: "Formatted at 2026-08-07 22:47:46 on dist-test-slave-tm1g"
server_key: "0abd646de18aa3ca89fc4af7fd2bff07"
server_key_iv: "559370eeba72f309dec9402014f1c8a1"
server_key_version: "encryptionkey@0"
I20260807 22:47:46.037200 16635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "9f22653f54d04e0794fdeb8508bd9827"
format_stamp: "Formatted at 2026-08-07 22:47:46 on dist-test-slave-tm1g"
server_key: "0abd646de18aa3ca89fc4af7fd2bff07"
server_key_iv: "559370eeba72f309dec9402014f1c8a1"
server_key_version: "encryptionkey@0"
I20260807 22:47:46.041050 16635 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260807 22:47:46.043627 16651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:46.045039 16635 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:47:46.045203 16635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "9f22653f54d04e0794fdeb8508bd9827"
format_stamp: "Formatted at 2026-08-07 22:47:46 on dist-test-slave-tm1g"
server_key: "0abd646de18aa3ca89fc4af7fd2bff07"
server_key_iv: "559370eeba72f309dec9402014f1c8a1"
server_key_version: "encryptionkey@0"
I20260807 22:47:46.045338 16635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:46.054943 16635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:46.058144 16635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:46.058436 16635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:46.059126 16635 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:46.059926 16635 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:46.059974 16635 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:46.060015 16635 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:46.060031 16635 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:46.069074 16635 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:43959
I20260807 22:47:46.069177 16766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:43959 every 8 connection(s)
I20260807 22:47:46.070020 16635 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:46.079144 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 16635
I20260807 22:47:46.079296 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:46.079605 12739 external_mini_cluster.cc:1428] Setting key 20974e47cba089e0a3d660ddd701d52d
Aug 07 22:47:46 dist-test-slave-tm1g krb5kdc[16388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142866, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:46.084452 16474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:46.071960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:49015 (local address 127.12.112.254:39159)
0807 22:47:46.072104 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:46.072108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:46.072885 (+ 777us) server_negotiation.cc:407] Connection header received
0807 22:47:46.074206 (+ 1321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:46.074210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:46.074260 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:46.074397 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:46.075553 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.076088 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.077265 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.077530 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.077621 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:46.080476 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:46.080479 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:46.080482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:46.080504 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:46.082032 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:46.082701 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:46.082703 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:46.082705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:46.082780 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:46.083153 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:46.083157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:46.083159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:46.083474 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:46.083587 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:46.084074 (+ 487us) server_negotiation.cc:299] Negotiation successful
0807 22:47:46.084222 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:47:46.085160 16769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:46.072268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39159 (local address 127.12.112.194:49015)
0807 22:47:46.072709 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:46.072753 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:46.073994 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:46.074566 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:46.074572 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:46.074925 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:46.075410 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:46.075424 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.076209 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.076211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:46.077122 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:46.077132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.077688 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.077691 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:46.077837 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:46.078516 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:46.078532 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:46.080298 (+ 1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:46.082154 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:46.082163 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:46.082181 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:46.082601 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:46.082891 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:46.082894 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:46.082896 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:46.083049 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:46.083592 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:46.083597 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:46.083834 (+ 237us) client_negotiation.cc:769] Sending connection context
0807 22:47:46.083994 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 22:47:46.084256 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":105,"threads_started":1}
I20260807 22:47:46.086483 16767 heartbeater.cc:347] Connected to a master server at 127.12.112.254:39159
I20260807 22:47:46.086759 16767 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:46.087298 16767 heartbeater.cc:511] Master 127.12.112.254:39159 requested a full tablet report, sending...
I20260807 22:47:46.088294 16434 ts_manager.cc:194] Registered new tserver with Master: 9f22653f54d04e0794fdeb8508bd9827 (127.12.112.194:43959)
I20260807 22:47:46.088881 16434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:49015
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:47:46.109426 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39159
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:46.222951 16772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:46.223336 16772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:46.223407 16772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:46.227878 16772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:46.227947 16772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:46.228009 16772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:46.233362 16772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:46.234539 16772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:46.235622 16772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:46.245636 16777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:46.245636 16780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:46.245731 16778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:46.245822 16772 server_base.cc:1034] running on GCE node
I20260807 22:47:46.246280 16772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:46.247005 16772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:46.248199 16772 hybrid_clock.cc:648] HybridClock initialized: now 1786142866248167 us; error 46 us; skew 500 ppm
Aug 07 22:47:46 dist-test-slave-tm1g krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142866, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:46.251348 16772 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:47:46.252286 16772 webserver.cc:460] Webserver started at http://127.12.112.195:45743/ using document root <none> and password file <none>
I20260807 22:47:46.252904 16772 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:46.252971 16772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:46.253226 16772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:46.255441 16772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "6410a941cfc5462aac92cbf61e3a7d76"
format_stamp: "Formatted at 2026-08-07 22:47:46 on dist-test-slave-tm1g"
server_key: "a7b34b0cb94750b9fbacb38a413972e4"
server_key_iv: "de8d2d9a4b57e12150b0f34ca03a596f"
server_key_version: "encryptionkey@0"
I20260807 22:47:46.256145 16772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "6410a941cfc5462aac92cbf61e3a7d76"
format_stamp: "Formatted at 2026-08-07 22:47:46 on dist-test-slave-tm1g"
server_key: "a7b34b0cb94750b9fbacb38a413972e4"
server_key_iv: "de8d2d9a4b57e12150b0f34ca03a596f"
server_key_version: "encryptionkey@0"
I20260807 22:47:46.260071 16772 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 22:47:46.262602 16788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:46.263840 16772 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:46.263989 16772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "6410a941cfc5462aac92cbf61e3a7d76"
format_stamp: "Formatted at 2026-08-07 22:47:46 on dist-test-slave-tm1g"
server_key: "a7b34b0cb94750b9fbacb38a413972e4"
server_key_iv: "de8d2d9a4b57e12150b0f34ca03a596f"
server_key_version: "encryptionkey@0"
I20260807 22:47:46.264108 16772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:46.276403 16772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:46.279565 16772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:46.279780 16772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:46.280400 16772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:46.281263 16772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:46.281345 16772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:46.281417 16772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:46.281461 16772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:46.290995 16772 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:37409
I20260807 22:47:46.291056 16903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:37409 every 8 connection(s)
I20260807 22:47:46.291987 16772 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:47:46.296746 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 16772
I20260807 22:47:46.296911 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:47:46.297220 12739 external_mini_cluster.cc:1428] Setting key 8d996126936d7a93d18699a06b1358ce
Aug 07 22:47:46 dist-test-slave-tm1g krb5kdc[16388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142866, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:46.306368 16474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:46.294004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:42361 (local address 127.12.112.254:39159)
0807 22:47:46.294147 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:46.294151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:46.295197 (+ 1046us) server_negotiation.cc:407] Connection header received
0807 22:47:46.296619 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:46.296623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:46.296687 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:46.296769 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:46.298079 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.298721 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.299890 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.300115 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.300230 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:46.302822 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:46.302826 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:46.302831 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:46.302862 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:46.304222 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:46.304752 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:46.304756 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:46.304757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:46.304843 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:46.305196 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:46.305200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:46.305202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:46.305414 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:46.305525 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:46.306034 (+ 509us) server_negotiation.cc:299] Negotiation successful
0807 22:47:46.306162 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:47:46.307241 16906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:46.294519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39159 (local address 127.12.112.195:42361)
0807 22:47:46.295036 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:46.295081 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:46.296366 (+ 1285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:46.296949 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:46.296956 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:46.297420 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:46.297929 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:46.297943 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.298854 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.298857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:46.299753 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:46.299762 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.300272 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.300276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:46.300458 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:46.301026 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:46.301043 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:46.302647 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:46.304350 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:46.304356 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:46.304380 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:46.304645 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:46.304946 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:46.304950 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:46.304952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:46.305100 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:46.305523 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:46.305530 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:46.305790 (+ 260us) client_negotiation.cc:769] Sending connection context
0807 22:47:46.305994 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 22:47:46.306384 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":130,"threads_started":1}
I20260807 22:47:46.308422 16904 heartbeater.cc:347] Connected to a master server at 127.12.112.254:39159
I20260807 22:47:46.308692 16904 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:46.309235 16904 heartbeater.cc:511] Master 127.12.112.254:39159 requested a full tablet report, sending...
I20260807 22:47:46.310578 16433 ts_manager.cc:194] Registered new tserver with Master: 6410a941cfc5462aac92cbf61e3a7d76 (127.12.112.195:37409)
I20260807 22:47:46.311355 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:47:46.311386 16433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:42361
Aug 07 22:47:46 dist-test-slave-tm1g krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:47:46 dist-test-slave-tm1g krb5kdc[16388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:47:46.339576 16911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:46.329713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53616 (local address 127.12.112.193:36993)
0807 22:47:46.329983 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:46.329999 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:46.330037 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:47:46.330089 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:46.330094 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:46.330284 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:46.330471 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:46.331175 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.331984 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.332884 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.333269 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.333360 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:46.335980 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:46.335990 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:46.336004 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:46.336029 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:46.337707 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:46.338154 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:46.338160 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:46.338161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:46.338243 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:46.338571 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:46.338574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:46.338575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:46.338841 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:46.339023 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:46.339220 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 22:47:46.339356 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":95,"threads_started":1}
Aug 07 22:47:46 dist-test-slave-tm1g krb5kdc[16388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:46.351133 16474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:46.342553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54350 (local address 127.12.112.254:39159)
0807 22:47:46.342706 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:46.342710 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:46.342726 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:47:46.342833 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:46.342836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:46.342884 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:46.342951 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:46.343641 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.344200 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.345007 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:46.345221 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:46.345316 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:46.347882 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:46.347885 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:46.347887 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:46.347911 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:46.349345 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:46.349776 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:46.349779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:46.349780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:46.349862 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:46.350111 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:46.350117 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:46.350120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:46.350417 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:46.350526 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:46.350790 (+ 264us) server_negotiation.cc:299] Negotiation successful
0807 22:47:46.350951 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260807 22:47:46.351574 16433 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54350
I20260807 22:47:46.352273 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 16498
I20260807 22:47:46.360440 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 16635
I20260807 22:47:46.369288 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 16772
I20260807 22:47:46.375398 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 16401
2026-08-07T22:47:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2181 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:46 dist-test-slave-tm1g krb5kdc[16916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:46 dist-test-slave-tm1g krb5kdc[16916](info): set up 2 sockets
Aug 07 22:47:46 dist-test-slave-tm1g krb5kdc[16916](info): commencing operation
krb5kdc: starting...
W20260807 22:47:47.461205 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:47 dist-test-slave-tm1g krb5kdc[16916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:47:47.589741 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:44325
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:41469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:44325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:47.704770 16929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:47.705060 16929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:47.705103 16929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:47.709200 16929 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:47.709273 16929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:47.709293 16929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:47.709309 16929 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:47.709326 16929 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:47.714766 16929 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:41469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:44325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:44325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:47.715870 16929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:47.716902 16929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:47.725546 16935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:47.725543 16936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:47.725597 16929 server_base.cc:1034] running on GCE node
W20260807 22:47:47.725546 16938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:47.726387 16929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:47.727593 16929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:47.728791 16929 hybrid_clock.cc:648] HybridClock initialized: now 1786142867728769 us; error 45 us; skew 500 ppm
Aug 07 22:47:47 dist-test-slave-tm1g krb5kdc[16916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142867, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:47.731732 16929 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:47:47.732576 16929 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:47.732688 16929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:47.732941 16929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:47.735206 16929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "1b95926c0ff542e9a0f74361b1c9fc8e"
format_stamp: "Formatted at 2026-08-07 22:47:47 on dist-test-slave-tm1g"
server_key: "30a1775d87c16a4c3ce801338566bd39"
server_key_iv: "e437034ef5a48a07c079b1ed6a02401b"
server_key_version: "encryptionkey@0"
I20260807 22:47:47.735806 16929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "1b95926c0ff542e9a0f74361b1c9fc8e"
format_stamp: "Formatted at 2026-08-07 22:47:47 on dist-test-slave-tm1g"
server_key: "30a1775d87c16a4c3ce801338566bd39"
server_key_iv: "e437034ef5a48a07c079b1ed6a02401b"
server_key_version: "encryptionkey@0"
I20260807 22:47:47.739620 16929 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:47:47.742349 16944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:47.744096 16929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:47:47.744226 16929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "1b95926c0ff542e9a0f74361b1c9fc8e"
format_stamp: "Formatted at 2026-08-07 22:47:47 on dist-test-slave-tm1g"
server_key: "30a1775d87c16a4c3ce801338566bd39"
server_key_iv: "e437034ef5a48a07c079b1ed6a02401b"
server_key_version: "encryptionkey@0"
I20260807 22:47:47.744354 16929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:47.755967 16929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:47.759100 16929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:47.759264 16929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:47.766264 16929 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:44325
I20260807 22:47:47.766593 17000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:44325 every 8 connection(s)
I20260807 22:47:47.767109 16929 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:47.769985 17001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:47.775898 17001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e: Bootstrap starting.
I20260807 22:47:47.777350 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 16929
I20260807 22:47:47.777501 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:47.777794 12739 external_mini_cluster.cc:1428] Setting key 1a8b5d77adeb406616c22b19af4c9713
I20260807 22:47:47.778944 17001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:47.779841 17001 log.cc:824] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:47.781790 17001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e: No bootstrap required, opened a new log
I20260807 22:47:47.785480 17001 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b95926c0ff542e9a0f74361b1c9fc8e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44325 } }
I20260807 22:47:47.785739 17001 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:47.785830 17001 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b95926c0ff542e9a0f74361b1c9fc8e, State: Initialized, Role: FOLLOWER
I20260807 22:47:47.786365 17001 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b95926c0ff542e9a0f74361b1c9fc8e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44325 } }
I20260807 22:47:47.786538 17001 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:47.786614 17001 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:47.786723 17001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [term 0 FOLLOWER]: Advancing to term 1
Aug 07 22:47:47 dist-test-slave-tm1g krb5kdc[16916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:47.787740 17001 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b95926c0ff542e9a0f74361b1c9fc8e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44325 } }
I20260807 22:47:47.788112 17001 leader_election.cc:302] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b95926c0ff542e9a0f74361b1c9fc8e; no voters:
I20260807 22:47:47.788486 17001 leader_election.cc:288] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:47.788614 17006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:47.788851 17006 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [term 1 LEADER]: Becoming Leader. State: Replica: 1b95926c0ff542e9a0f74361b1c9fc8e, State: Running, Role: LEADER
I20260807 22:47:47.789249 17006 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b95926c0ff542e9a0f74361b1c9fc8e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44325 } }
I20260807 22:47:47.789929 17001 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:47.791270 17008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b95926c0ff542e9a0f74361b1c9fc8e. Latest consensus state: current_term: 1 leader_uuid: "1b95926c0ff542e9a0f74361b1c9fc8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b95926c0ff542e9a0f74361b1c9fc8e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44325 } } }
I20260807 22:47:47.791733 17008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:47.791621 17007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b95926c0ff542e9a0f74361b1c9fc8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b95926c0ff542e9a0f74361b1c9fc8e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44325 } } }
I20260807 22:47:47.792752 17007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:47.793628 17004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:47.779096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48866 (local address 127.12.112.254:44325)
0807 22:47:47.779574 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:47.779589 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:47.779625 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:47:47.780346 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:47.780365 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:47.780686 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:47.781037 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:47.781904 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:47.782999 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:47.783885 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:47.784378 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:47.784551 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:47.787403 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:47.787408 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:47.787421 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:47.787452 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:47.789557 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:47.790151 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:47.790157 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:47.790164 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:47.790355 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:47.790704 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:47.790707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:47.790709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:47.791309 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:47.791510 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:47.792479 (+ 969us) server_negotiation.cc:299] Negotiation successful
0807 22:47:47.792825 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":152,"threads_started":1}
W20260807 22:47:47.795436 17021 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:47:47.795521 17021 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:47:47.795589 17019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:47.796291 17019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:47.802024 17019 catalog_manager.cc:1347] Generated new cluster ID: 99148bebb7e447c3b76007425b2ad21d
I20260807 22:47:47.802099 17019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:47.813010 17019 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:47.814066 17019 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:47.821694 17019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e: Generated new TSK 0
I20260807 22:47:47.822561 17019 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:47:47.868955 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44325
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:41469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:47.990532 17027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:47.990896 17027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:47.991010 17027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:47.995437 17027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:47.995498 17027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:47.995560 17027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:48.001237 17027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:41469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:48.002480 17027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:48.003559 17027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:48.013331 17035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:48.013343 17032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:48.013283 17033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:48.013564 17027 server_base.cc:1034] running on GCE node
I20260807 22:47:48.014061 17027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:48.014858 17027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:48.016057 17027 hybrid_clock.cc:648] HybridClock initialized: now 1786142868016045 us; error 29 us; skew 500 ppm
Aug 07 22:47:48 dist-test-slave-tm1g krb5kdc[16916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142868, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:48.018981 17027 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:47:48.019798 17027 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:48.019896 17027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:48.020148 17027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:48.022293 17027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "e2caac37098a4381802b51c050a41a09"
format_stamp: "Formatted at 2026-08-07 22:47:48 on dist-test-slave-tm1g"
server_key: "5640c4398f3cab25a776172641711629"
server_key_iv: "92bbd96b6ff1f24f3e8ddbe2b9707638"
server_key_version: "encryptionkey@0"
I20260807 22:47:48.022974 17027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "e2caac37098a4381802b51c050a41a09"
format_stamp: "Formatted at 2026-08-07 22:47:48 on dist-test-slave-tm1g"
server_key: "5640c4398f3cab25a776172641711629"
server_key_iv: "92bbd96b6ff1f24f3e8ddbe2b9707638"
server_key_version: "encryptionkey@0"
I20260807 22:47:48.026939 17027 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:47:48.029479 17041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:48.030879 17027 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:48.031028 17027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "e2caac37098a4381802b51c050a41a09"
format_stamp: "Formatted at 2026-08-07 22:47:48 on dist-test-slave-tm1g"
server_key: "5640c4398f3cab25a776172641711629"
server_key_iv: "92bbd96b6ff1f24f3e8ddbe2b9707638"
server_key_version: "encryptionkey@0"
I20260807 22:47:48.031150 17027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:48.048671 17027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:48.051826 17027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:48.052044 17027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:48.052654 17027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:48.053508 17027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:48.053579 17027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:48.053651 17027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:48.053704 17027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:48.062783 17027 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:37261
I20260807 22:47:48.062810 17163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:37261 every 8 connection(s)
I20260807 22:47:48.063418 17027 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:48.066552 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 17027
I20260807 22:47:48.066706 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:48.067004 12739 external_mini_cluster.cc:1428] Setting key 7c6aee13a516810f8d5c3d0c6b5b3c03
Aug 07 22:47:48 dist-test-slave-tm1g krb5kdc[16916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142868, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:48.077940 17004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.065208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:41687 (local address 127.12.112.254:44325)
0807 22:47:48.065373 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:48.065383 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:48.066184 (+ 801us) server_negotiation.cc:407] Connection header received
0807 22:47:48.067726 (+ 1542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:48.067729 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:48.067790 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:48.067899 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:48.069192 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.069749 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.070973 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.071221 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.071334 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.073985 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:48.073992 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:48.073998 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:48.074033 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:48.075797 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:48.076293 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:48.076298 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:48.076302 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:48.076414 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:48.076748 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:48.076753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:48.076755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:48.077009 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:48.077114 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:48.077597 (+ 483us) server_negotiation.cc:299] Negotiation successful
0807 22:47:48.077757 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":72}
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:47:48.078619 17166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.065581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:44325 (local address 127.12.112.193:41687)
0807 22:47:48.066034 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:48.066076 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:48.067509 (+ 1433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:48.068091 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:48.068097 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:48.068562 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:48.069042 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.069054 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.069889 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.069898 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.070841 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.070850 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.071373 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.071377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.071552 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.072107 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:48.072133 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:48.073810 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:48.075916 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:48.075920 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:48.075937 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:48.076187 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:48.076518 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:48.076520 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:48.076521 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:48.076651 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:48.077113 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:48.077117 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:48.077343 (+ 226us) client_negotiation.cc:769] Sending connection context
0807 22:47:48.077499 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 22:47:48.077745 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":114,"threads_started":1}
I20260807 22:47:48.079928 17164 heartbeater.cc:347] Connected to a master server at 127.12.112.254:44325
I20260807 22:47:48.080233 17164 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:48.080778 17164 heartbeater.cc:511] Master 127.12.112.254:44325 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:47:48.082578 16961 ts_manager.cc:194] Registered new tserver with Master: e2caac37098a4381802b51c050a41a09 (127.12.112.193:37261)
I20260807 22:47:48.083830 16961 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:41687
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:47:48.098125 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44325
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:41469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:48.211992 17169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:48.212240 17169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:48.212327 17169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:48.216431 17169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:48.216499 17169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:48.216589 17169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:48.221936 17169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:41469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:48.223085 17169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:48.224140 17169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:48.233882 17175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:48.233978 17174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:48.233882 17177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:48.234109 17169 server_base.cc:1034] running on GCE node
I20260807 22:47:48.234750 17169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:48.235473 17169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:48.236652 17169 hybrid_clock.cc:648] HybridClock initialized: now 1786142868236638 us; error 28 us; skew 500 ppm
Aug 07 22:47:48 dist-test-slave-tm1g krb5kdc[16916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142868, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:48.239650 17169 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:47:48.240425 17169 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:48.240506 17169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:48.240679 17169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:48.242846 17169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "295f984c68f34647b24581258ad46073"
format_stamp: "Formatted at 2026-08-07 22:47:48 on dist-test-slave-tm1g"
server_key: "8c1f86a805b96a69a794764aa6df832c"
server_key_iv: "efbe8aba3740014f8928ecf53ba369e6"
server_key_version: "encryptionkey@0"
I20260807 22:47:48.243369 17169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "295f984c68f34647b24581258ad46073"
format_stamp: "Formatted at 2026-08-07 22:47:48 on dist-test-slave-tm1g"
server_key: "8c1f86a805b96a69a794764aa6df832c"
server_key_iv: "efbe8aba3740014f8928ecf53ba369e6"
server_key_version: "encryptionkey@0"
I20260807 22:47:48.247376 17169 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:47:48.249986 17183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:48.251368 17169 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:47:48.251534 17169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "295f984c68f34647b24581258ad46073"
format_stamp: "Formatted at 2026-08-07 22:47:48 on dist-test-slave-tm1g"
server_key: "8c1f86a805b96a69a794764aa6df832c"
server_key_iv: "efbe8aba3740014f8928ecf53ba369e6"
server_key_version: "encryptionkey@0"
I20260807 22:47:48.251664 17169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:48.267400 17169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:48.270889 17169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:48.271104 17169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:48.271741 17169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:48.272617 17169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:48.272663 17169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:48.272732 17169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:48.272768 17169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:48.282225 17169 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:45065
I20260807 22:47:48.282280 17300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:45065 every 8 connection(s)
I20260807 22:47:48.282919 17169 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:48.285487 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 17169
I20260807 22:47:48.285630 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:48.286006 12739 external_mini_cluster.cc:1428] Setting key a635ac822f9340438dbe5c608cf5a906
Aug 07 22:47:48 dist-test-slave-tm1g krb5kdc[16916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142868, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:47:48.299654 17004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.284787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:50239 (local address 127.12.112.254:44325)
0807 22:47:48.284945 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:48.284949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:48.286005 (+ 1056us) server_negotiation.cc:407] Connection header received
0807 22:47:48.287773 (+ 1768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:48.287777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:48.287847 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:48.287928 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:48.289227 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.290254 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.291641 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.292126 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.292285 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.295514 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:48.295518 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:48.295521 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:48.295560 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:48.297074 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:48.297663 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:48.297668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:48.297670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:48.297800 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:48.298197 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:48.298200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:48.298202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:48.298502 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:48.298624 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:48.299288 (+ 664us) server_negotiation.cc:299] Negotiation successful
0807 22:47:48.299456 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:47:48.300621 17303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.285160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:44325 (local address 127.12.112.194:50239)
0807 22:47:48.285825 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:48.285875 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:48.287547 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:48.288115 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:48.288122 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:48.288548 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:48.289070 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.289084 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.290426 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.290429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.291496 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.291507 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.292314 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.292320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.292557 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.293311 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:48.293350 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:48.295314 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:48.297211 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:48.297218 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:48.297237 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:48.297542 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:48.297919 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:48.297923 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:48.297925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:48.298089 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:48.298619 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:48.298627 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:48.299007 (+ 380us) client_negotiation.cc:769] Sending connection context
0807 22:47:48.299241 (+ 234us) client_negotiation.cc:240] Negotiation successful
0807 22:47:48.299632 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":162,"threads_started":1}
I20260807 22:47:48.302034 17301 heartbeater.cc:347] Connected to a master server at 127.12.112.254:44325
I20260807 22:47:48.302337 17301 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:48.302966 17301 heartbeater.cc:511] Master 127.12.112.254:44325 requested a full tablet report, sending...
I20260807 22:47:48.304339 16961 ts_manager.cc:194] Registered new tserver with Master: 295f984c68f34647b24581258ad46073 (127.12.112.194:45065)
I20260807 22:47:48.304982 16961 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:50239
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:47:48.319199 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44325
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:41469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:48.432111 17306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:48.432368 17306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:48.432415 17306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:48.436715 17306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:48.436777 17306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:48.436872 17306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:48.443639 17306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:41469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:48.444777 17306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:48.445849 17306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:48.455617 17312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:48.455617 17314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:48.455611 17311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:48.455653 17306 server_base.cc:1034] running on GCE node
I20260807 22:47:48.456374 17306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:48.457042 17306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:48.458228 17306 hybrid_clock.cc:648] HybridClock initialized: now 1786142868458218 us; error 33 us; skew 500 ppm
Aug 07 22:47:48 dist-test-slave-tm1g krb5kdc[16916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142868, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:48.460983 17306 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:47:48.461747 17306 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:48.461844 17306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:48.462091 17306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:48.464254 17306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "055a9c25744743e1ada972c29695b47f"
format_stamp: "Formatted at 2026-08-07 22:47:48 on dist-test-slave-tm1g"
server_key: "a7955a67b8560ab0470c428c775ac47c"
server_key_iv: "de0b5f93175b1e091e858caaddc4209e"
server_key_version: "encryptionkey@0"
I20260807 22:47:48.464844 17306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "055a9c25744743e1ada972c29695b47f"
format_stamp: "Formatted at 2026-08-07 22:47:48 on dist-test-slave-tm1g"
server_key: "a7955a67b8560ab0470c428c775ac47c"
server_key_iv: "de0b5f93175b1e091e858caaddc4209e"
server_key_version: "encryptionkey@0"
I20260807 22:47:48.468708 17306 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260807 22:47:48.471225 17320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:48.472505 17306 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260807 22:47:48.472646 17306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "055a9c25744743e1ada972c29695b47f"
format_stamp: "Formatted at 2026-08-07 22:47:48 on dist-test-slave-tm1g"
server_key: "a7955a67b8560ab0470c428c775ac47c"
server_key_iv: "de0b5f93175b1e091e858caaddc4209e"
server_key_version: "encryptionkey@0"
I20260807 22:47:48.472764 17306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:48.497953 17306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:48.501143 17306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:48.501358 17306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:48.502007 17306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:48.502897 17306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:48.502974 17306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:48.503047 17306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:48.503099 17306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:48.512254 17306 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:44711
I20260807 22:47:48.512279 17436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:44711 every 8 connection(s)
I20260807 22:47:48.512894 17306 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:47:48.516460 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 17306
I20260807 22:47:48.516603 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:47:48.516884 12739 external_mini_cluster.cc:1428] Setting key 8dbf704d927c209a6d2668a65d70ee56
Aug 07 22:47:48 dist-test-slave-tm1g krb5kdc[16916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142868, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:48.527482 17004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.514719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:53271 (local address 127.12.112.254:44325)
0807 22:47:48.514871 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:48.514875 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:48.515729 (+ 854us) server_negotiation.cc:407] Connection header received
0807 22:47:48.517132 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:48.517136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:48.517197 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:48.517290 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:48.518940 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.519660 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.520795 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.521026 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.521104 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.523807 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:48.523810 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:48.523812 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:48.523837 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:48.525182 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:48.525701 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:48.525704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:48.525705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:48.525786 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:48.526123 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:48.526126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:48.526127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:48.526440 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:48.526577 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:48.527113 (+ 536us) server_negotiation.cc:299] Negotiation successful
0807 22:47:48.527253 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:47:48.528309 17440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.515117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:44325 (local address 127.12.112.195:53271)
0807 22:47:48.515570 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:48.515615 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:48.516870 (+ 1255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:48.517509 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:48.517516 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:48.518038 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:48.518774 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.518795 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.519781 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.519784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.520688 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.520697 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.521157 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.521160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.521311 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.521957 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:48.521981 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:48.523638 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:48.525308 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:48.525313 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:48.525326 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:48.525602 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:48.525871 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:48.525873 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:48.525874 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:48.526006 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:48.526576 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:48.526583 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:48.526858 (+ 275us) client_negotiation.cc:769] Sending connection context
0807 22:47:48.527065 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 22:47:48.527446 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":117,"threads_started":1}
I20260807 22:47:48.529548 17437 heartbeater.cc:347] Connected to a master server at 127.12.112.254:44325
I20260807 22:47:48.529816 17437 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:48.530344 17437 heartbeater.cc:511] Master 127.12.112.254:44325 requested a full tablet report, sending...
I20260807 22:47:48.531402 16961 ts_manager.cc:194] Registered new tserver with Master: 055a9c25744743e1ada972c29695b47f (127.12.112.195:44711)
I20260807 22:47:48.531949 16961 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:53271
I20260807 22:47:48.542999 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:47:48.552680 17004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.544959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44234 (local address 127.12.112.254:44325)
0807 22:47:48.545104 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:48.545109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:48.545305 (+ 196us) server_negotiation.cc:407] Connection header received
0807 22:47:48.545408 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:48.545410 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:48.545453 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:48.545518 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:48.546221 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.546795 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.547602 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.547809 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.547884 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.549447 (+ 1563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:48.549450 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:48.549452 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:48.549476 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:48.551013 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:48.551395 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:48.551397 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:48.551398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:48.551474 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:48.551729 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:48.551732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:48.551733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:48.552001 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:48.552119 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:48.552317 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 22:47:48.552466 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:47:48.555733 16961 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44234:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:47:48.558990 16961 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:48.573459 17449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.567459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:37261 (local address 127.0.0.1:59742)
0807 22:47:48.568130 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:48.568181 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:48.568317 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:48.569361 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:48.569365 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:48.569384 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:48.569501 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.569510 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.570669 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.570672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.571963 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.571972 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.572823 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.572827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.572956 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.573041 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 22:47:48.573167 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 22:47:48.573288 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":29,"thread_start_us":67,"threads_started":1}
I20260807 22:47:48.573542 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.567637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59742 (local address 127.12.112.193:37261)
0807 22:47:48.569003 (+ 1366us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:48.569008 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:48.569025 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:47:48.569085 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:48.569088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:48.569222 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:48.569387 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:48.569628 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.570544 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.572090 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.572695 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.572836 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.572978 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:48.573206 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 22:47:48.573318 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1279,"thread_start_us":113,"threads_started":1}
I20260807 22:47:48.573648 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.568126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40158 (local address 127.12.112.195:44711)
0807 22:47:48.568821 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:48.568831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:48.568854 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:47:48.568930 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:48.568934 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:48.569086 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:48.569250 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:48.569570 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.570778 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.572211 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.573015 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.573150 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.573274 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:48.573327 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 22:47:48.573492 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":171,"threads_started":1}
I20260807 22:47:48.573467 17452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.567459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44711 (local address 127.0.0.1:40158)
0807 22:47:48.568697 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:48.568712 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:48.568798 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:48.569237 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:48.569243 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:48.569264 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:48.569424 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.569432 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.570963 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.570966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.572081 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.572091 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.573141 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.573146 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.573233 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.573254 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:47:48.573310 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:47:48.573361 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1167,"mutex_wait_us":159,"thread_start_us":92,"threads_started":1}
I20260807 22:47:48.576061 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.568271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41032 (local address 127.12.112.194:45065)
0807 22:47:48.568684 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:48.568702 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:48.569714 (+ 1012us) server_negotiation.cc:407] Connection header received
0807 22:47:48.569794 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:48.569798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:48.569968 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:48.570108 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:48.570368 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.571702 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.573519 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.575440 (+ 1921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.575600 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.575732 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:48.575827 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 22:47:48.575912 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":152,"threads_started":1}
I20260807 22:47:48.576056 17450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.567743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:45065 (local address 127.0.0.1:41032)
0807 22:47:48.569522 (+ 1779us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:48.569537 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:48.569628 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:48.570120 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:48.570123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:48.570143 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:48.570234 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.570239 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.571840 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.571844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.573014 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.573023 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.575584 (+ 2561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.575588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.575673 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.575695 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:47:48.575791 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 22:47:48.575866 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1704,"mutex_wait_us":1,"thread_start_us":97,"threads_started":1}
I20260807 22:47:48.577270 17095 tablet_service.cc:1467] Processing CreateTablet for tablet 945246ad9fca4f6da8e2d28261d78f2d (DEFAULT_TABLE table=test-table [id=f40819e026bf4943be6e2bbd1fd15926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:48.577272 17370 tablet_service.cc:1467] Processing CreateTablet for tablet 945246ad9fca4f6da8e2d28261d78f2d (DEFAULT_TABLE table=test-table [id=f40819e026bf4943be6e2bbd1fd15926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:48.578486 17370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 945246ad9fca4f6da8e2d28261d78f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:48.578485 17095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 945246ad9fca4f6da8e2d28261d78f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:48.584380 17234 tablet_service.cc:1467] Processing CreateTablet for tablet 945246ad9fca4f6da8e2d28261d78f2d (DEFAULT_TABLE table=test-table [id=f40819e026bf4943be6e2bbd1fd15926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:48.585347 17234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 945246ad9fca4f6da8e2d28261d78f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:48.586112 17455 tablet_bootstrap.cc:492] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09: Bootstrap starting.
I20260807 22:47:48.586556 17456 tablet_bootstrap.cc:492] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: Bootstrap starting.
I20260807 22:47:48.588949 17456 tablet_bootstrap.cc:654] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:48.590425 17456 log.cc:824] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:48.591503 17455 tablet_bootstrap.cc:654] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:48.592329 17455 log.cc:824] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:48.592748 17456 tablet_bootstrap.cc:492] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: No bootstrap required, opened a new log
I20260807 22:47:48.592998 17456 ts_tablet_manager.cc:1397] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:47:48.593271 17459 tablet_bootstrap.cc:492] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: Bootstrap starting.
I20260807 22:47:48.594496 17455 tablet_bootstrap.cc:492] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09: No bootstrap required, opened a new log
I20260807 22:47:48.594704 17455 ts_tablet_manager.cc:1397] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260807 22:47:48.595480 17459 tablet_bootstrap.cc:654] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:48.596747 17459 log.cc:824] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:48.597172 17456 raft_consensus.cc:348] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 } } peers { permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 } } peers { permanent_uuid: "295f984c68f34647b24581258ad46073" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 45065 } }
I20260807 22:47:48.597450 17456 raft_consensus.cc:374] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:48.597535 17456 raft_consensus.cc:729] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 055a9c25744743e1ada972c29695b47f, State: Initialized, Role: FOLLOWER
I20260807 22:47:48.598011 17456 consensus_queue.cc:260] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 } } peers { permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 } } peers { permanent_uuid: "295f984c68f34647b24581258ad46073" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 45065 } }
I20260807 22:47:48.598737 17437 heartbeater.cc:503] Master 127.12.112.254:44325 was elected leader, sending a full tablet report...
I20260807 22:47:48.599067 17456 ts_tablet_manager.cc:1428] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20260807 22:47:48.599037 17455 raft_consensus.cc:348] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 } } peers { permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 } } peers { permanent_uuid: "295f984c68f34647b24581258ad46073" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 45065 } }
I20260807 22:47:48.599327 17455 raft_consensus.cc:374] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:48.599404 17455 raft_consensus.cc:729] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2caac37098a4381802b51c050a41a09, State: Initialized, Role: FOLLOWER
I20260807 22:47:48.599840 17455 consensus_queue.cc:260] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 } } peers { permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 } } peers { permanent_uuid: "295f984c68f34647b24581258ad46073" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 45065 } }
I20260807 22:47:48.600080 17459 tablet_bootstrap.cc:492] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: No bootstrap required, opened a new log
I20260807 22:47:48.600281 17459 ts_tablet_manager.cc:1397] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:47:48.600581 17164 heartbeater.cc:503] Master 127.12.112.254:44325 was elected leader, sending a full tablet report...
I20260807 22:47:48.600925 17455 ts_tablet_manager.cc:1428] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260807 22:47:48.604449 17459 raft_consensus.cc:348] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 } } peers { permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 } } peers { permanent_uuid: "295f984c68f34647b24581258ad46073" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 45065 } }
I20260807 22:47:48.604758 17459 raft_consensus.cc:374] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:48.604836 17459 raft_consensus.cc:729] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295f984c68f34647b24581258ad46073, State: Initialized, Role: FOLLOWER
I20260807 22:47:48.605329 17459 consensus_queue.cc:260] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 } } peers { permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 } } peers { permanent_uuid: "295f984c68f34647b24581258ad46073" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 45065 } }
I20260807 22:47:48.606000 17301 heartbeater.cc:503] Master 127.12.112.254:44325 was elected leader, sending a full tablet report...
I20260807 22:47:48.606249 17459 ts_tablet_manager.cc:1428] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260807 22:47:48.763952 17438 tablet.cc:2369] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:47:48.784077 17302 tablet.cc:2369] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:47:48.814888 17165 tablet.cc:2369] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:47:48.871353 17463 raft_consensus.cc:482] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:48.871579 17463 raft_consensus.cc:504] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 } } peers { permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 } } peers { permanent_uuid: "295f984c68f34647b24581258ad46073" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 45065 } }
I20260807 22:47:48.872737 17463 leader_election.cc:288] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2caac37098a4381802b51c050a41a09 (127.12.112.193:37261), 055a9c25744743e1ada972c29695b47f (127.12.112.195:44711)
I20260807 22:47:48.876886 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.873095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:35451 (local address 127.12.112.193:37261)
0807 22:47:48.873252 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:48.873258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:48.873351 (+ 93us) server_negotiation.cc:407] Connection header received
0807 22:47:48.873609 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:48.873613 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:48.873670 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:48.873746 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:48.874097 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.874717 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.875839 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.876249 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.876434 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.876500 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:48.876676 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 22:47:48.876743 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 22:47:48.876917 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.873273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:54555 (local address 127.12.112.195:44711)
0807 22:47:48.873439 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:48.873444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:48.873585 (+ 141us) server_negotiation.cc:407] Connection header received
0807 22:47:48.873717 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:48.873720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:48.873789 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:48.873863 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:48.874163 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.874684 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.875886 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.876340 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.876484 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.876534 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:48.876715 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 22:47:48.876784 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 22:47:48.876960 17465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.873078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44711 (local address 127.12.112.194:54555)
0807 22:47:48.873460 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:48.873471 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:48.873608 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:48.873907 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:48.873909 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:48.873925 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:48.874051 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.874060 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.874792 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.874798 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.875719 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.875728 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.876484 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.876488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.876595 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.876613 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 22:47:48.876700 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 22:47:48.876772 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":45,"thread_start_us":77,"threads_started":1}
I20260807 22:47:48.876969 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.872936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:37261 (local address 127.12.112.194:35451)
0807 22:47:48.873249 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:48.873265 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:48.873448 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:48.873783 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:48.873786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:48.873805 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:48.873965 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.873972 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.874862 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.874864 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.875717 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:48.875725 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.876425 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.876428 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:48.876534 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.876563 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 22:47:48.876650 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 22:47:48.876726 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":23,"thread_start_us":80,"threads_started":1}
I20260807 22:47:48.877686 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945246ad9fca4f6da8e2d28261d78f2d" candidate_uuid: "295f984c68f34647b24581258ad46073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "055a9c25744743e1ada972c29695b47f" is_pre_election: true
I20260807 22:47:48.877745 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945246ad9fca4f6da8e2d28261d78f2d" candidate_uuid: "295f984c68f34647b24581258ad46073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2caac37098a4381802b51c050a41a09" is_pre_election: true
I20260807 22:47:48.878011 17391 raft_consensus.cc:2454] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295f984c68f34647b24581258ad46073 in term 0.
I20260807 22:47:48.878042 17116 raft_consensus.cc:2454] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295f984c68f34647b24581258ad46073 in term 0.
I20260807 22:47:48.878532 17187 leader_election.cc:302] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 055a9c25744743e1ada972c29695b47f, 295f984c68f34647b24581258ad46073; no voters:
I20260807 22:47:48.878837 17463 raft_consensus.cc:2781] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:48.878932 17463 raft_consensus.cc:482] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:48.878979 17463 raft_consensus.cc:3037] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:48.880048 17463 raft_consensus.cc:504] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 } } peers { permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 } } peers { permanent_uuid: "295f984c68f34647b24581258ad46073" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 45065 } }
I20260807 22:47:48.880409 17463 leader_election.cc:288] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [CANDIDATE]: Term 1 election: Requested vote from peers e2caac37098a4381802b51c050a41a09 (127.12.112.193:37261), 055a9c25744743e1ada972c29695b47f (127.12.112.195:44711)
I20260807 22:47:48.880707 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945246ad9fca4f6da8e2d28261d78f2d" candidate_uuid: "295f984c68f34647b24581258ad46073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2caac37098a4381802b51c050a41a09"
I20260807 22:47:48.880838 17116 raft_consensus.cc:3037] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:48.880836 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945246ad9fca4f6da8e2d28261d78f2d" candidate_uuid: "295f984c68f34647b24581258ad46073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "055a9c25744743e1ada972c29695b47f"
I20260807 22:47:48.880980 17391 raft_consensus.cc:3037] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:48.881898 17116 raft_consensus.cc:2454] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295f984c68f34647b24581258ad46073 in term 1.
I20260807 22:47:48.882094 17391 raft_consensus.cc:2454] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295f984c68f34647b24581258ad46073 in term 1.
I20260807 22:47:48.882233 17186 leader_election.cc:302] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295f984c68f34647b24581258ad46073, e2caac37098a4381802b51c050a41a09; no voters:
I20260807 22:47:48.882449 17463 raft_consensus.cc:2781] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:48.882699 17463 raft_consensus.cc:686] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 1 LEADER]: Becoming Leader. State: Replica: 295f984c68f34647b24581258ad46073, State: Running, Role: LEADER
I20260807 22:47:48.883028 17463 consensus_queue.cc:237] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 } } peers { permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 } } peers { permanent_uuid: "295f984c68f34647b24581258ad46073" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 45065 } }
I20260807 22:47:48.886219 16961 catalog_manager.cc:5495] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 reported cstate change: term changed from 0 to 1, leader changed from <none> to 295f984c68f34647b24581258ad46073 (127.12.112.194). New cstate: current_term: 1 leader_uuid: "295f984c68f34647b24581258ad46073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295f984c68f34647b24581258ad46073" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 45065 } health_report { overall_health: HEALTHY } } }
I20260807 22:47:48.936674 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.932873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41046 (local address 127.12.112.194:45065)
0807 22:47:48.933036 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:48.933043 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:48.933060 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:47:48.933152 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:48.933154 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:48.933213 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:48.933332 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:48.933610 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.934225 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.935143 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:48.935384 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:48.935498 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:48.935824 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:48.936254 (+ 430us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:48.936389 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:48.936459 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 22:47:48.936517 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:47:48.942906 17391 raft_consensus.cc:1261] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f [term 1 FOLLOWER]: Refusing update from remote peer 295f984c68f34647b24581258ad46073: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:48.942939 17116 raft_consensus.cc:1261] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09 [term 1 FOLLOWER]: Refusing update from remote peer 295f984c68f34647b24581258ad46073: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:48.943657 17466 consensus_queue.cc:1035] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2caac37098a4381802b51c050a41a09" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:48.943861 17463 consensus_queue.cc:1035] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "055a9c25744743e1ada972c29695b47f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:48.953011 17470 mvcc.cc:205] Tried to move back new op lower bound from 7316041191182131200 to 7316041190947745792. Current Snapshot: MvccSnapshot[applied={T|T < 7316041191182131200}]
I20260807 22:47:48.953259 17471 mvcc.cc:205] Tried to move back new op lower bound from 7316041191182131200 to 7316041190947745792. Current Snapshot: MvccSnapshot[applied={T|T < 7316041191182131200}]
I20260807 22:47:48.959086 16961 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:48.959276 16961 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:48.961773 16961 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b95926c0ff542e9a0f74361b1c9fc8e: Sending DeleteTablet for 3 replicas of tablet 945246ad9fca4f6da8e2d28261d78f2d
I20260807 22:47:48.962580 17370 tablet_service.cc:1514] Processing DeleteTablet for tablet 945246ad9fca4f6da8e2d28261d78f2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:48 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:40158
I20260807 22:47:48.962601 17234 tablet_service.cc:1514] Processing DeleteTablet for tablet 945246ad9fca4f6da8e2d28261d78f2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:48 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:41032
I20260807 22:47:48.963092 17478 tablet_replica.cc:330] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: stopping tablet replica
I20260807 22:47:48.963116 17095 tablet_service.cc:1514] Processing DeleteTablet for tablet 945246ad9fca4f6da8e2d28261d78f2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:48 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:59742
I20260807 22:47:48.963443 17478 raft_consensus.cc:2229] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:48.963582 17480 tablet_replica.cc:330] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09: stopping tablet replica
I20260807 22:47:48.963762 17478 raft_consensus.cc:2258] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:48.963927 17480 raft_consensus.cc:2229] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:48.964226 17480 raft_consensus.cc:2258] T 945246ad9fca4f6da8e2d28261d78f2d P e2caac37098a4381802b51c050a41a09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:48.964643 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 17027
I20260807 22:47:48.965504 17478 ts_tablet_manager.cc:1905] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:48.966445 17479 tablet_replica.cc:330] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: stopping tablet replica
I20260807 22:47:48.966776 17479 raft_consensus.cc:2229] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:47:48.967172 17479 raft_consensus.cc:2258] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:48.968624 17479 ts_tablet_manager.cc:1905] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:48.969089 17478 ts_tablet_manager.cc:1918] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:47:48.969228 17478 log.cc:1196] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/945246ad9fca4f6da8e2d28261d78f2d
I20260807 22:47:48.969691 17478 ts_tablet_manager.cc:1939] T 945246ad9fca4f6da8e2d28261d78f2d P 055a9c25744743e1ada972c29695b47f: Deleting consensus metadata
I20260807 22:47:48.971372 17479 ts_tablet_manager.cc:1918] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:47:48.971385 16948 catalog_manager.cc:4841] TS 055a9c25744743e1ada972c29695b47f (127.12.112.195:44711): tablet 945246ad9fca4f6da8e2d28261d78f2d (table test-table [id=f40819e026bf4943be6e2bbd1fd15926]) successfully deleted
I20260807 22:47:48.971468 17479 log.cc:1196] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/945246ad9fca4f6da8e2d28261d78f2d
I20260807 22:47:48.971769 17479 ts_tablet_manager.cc:1939] T 945246ad9fca4f6da8e2d28261d78f2d P 295f984c68f34647b24581258ad46073: Deleting consensus metadata
I20260807 22:47:48.972842 16945 catalog_manager.cc:4841] TS 295f984c68f34647b24581258ad46073 (127.12.112.194:45065): tablet 945246ad9fca4f6da8e2d28261d78f2d (table test-table [id=f40819e026bf4943be6e2bbd1fd15926]) successfully deleted
W20260807 22:47:48.976176 16947 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:37261 (error 108)
I20260807 22:47:48.976300 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 17169
I20260807 22:47:48.978209 17450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:48.977930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:37261 (local address 127.0.0.1:59748)
0807 22:47:48.978064 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:48.978134 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:37261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 22:47:48.978518 16947 catalog_manager.cc:4584] TS e2caac37098a4381802b51c050a41a09 (127.12.112.193:37261): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 945246ad9fca4f6da8e2d28261d78f2d: Network error: Client connection negotiation failed: client connection to 127.12.112.193:37261: connect: Connection refused (error 111)
I20260807 22:47:48.983788 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 17306
I20260807 22:47:48.990890 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 16929
2026-08-07T22:47:48Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2615 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T22:47:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:49Z Disabled control of system clock
I20260807 22:47:49.023595 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33081
--webserver_interface=127.12.112.254
--webserver_port=0
--builtin_ntp_servers=127.12.112.212:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:33081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 22:47:49.135975 17485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:49.136274 17485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:49.136312 17485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:49.140417 17485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:49.140483 17485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:49.140499 17485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:49.140516 17485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:49.140532 17485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:49.145442 17485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:33081
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:49.146665 17485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:49.148079 17485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:49.156718 17491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:49.156774 17492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:49.156718 17494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:49.157059 17485 server_base.cc:1034] running on GCE node
I20260807 22:47:49.157641 17485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:49.158861 17485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:49.160056 17485 hybrid_clock.cc:648] HybridClock initialized: now 1786142869160041 us; error 32 us; skew 500 ppm
I20260807 22:47:49.161998 17485 webserver.cc:460] Webserver started at http://127.12.112.254:40703/ using document root <none> and password file <none>
I20260807 22:47:49.162662 17485 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:49.162729 17485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:49.162961 17485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:49.165057 17485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "478350e7c5db4ac3ab271a4014fced79"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "a4b20ed836a2f9f014eda51ab6acd827"
server_key_iv: "eddd142922e36fdee1bba5ffe68b2e83"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.165673 17485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "478350e7c5db4ac3ab271a4014fced79"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "a4b20ed836a2f9f014eda51ab6acd827"
server_key_iv: "eddd142922e36fdee1bba5ffe68b2e83"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.169425 17485 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 22:47:49.171999 17500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:49.173233 17485 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:49.173374 17485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "478350e7c5db4ac3ab271a4014fced79"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "a4b20ed836a2f9f014eda51ab6acd827"
server_key_iv: "eddd142922e36fdee1bba5ffe68b2e83"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.173496 17485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:49.178161 17485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:49.178846 17485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:49.179060 17485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:49.186017 17554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:33081 every 8 connection(s)
I20260807 22:47:49.186059 17485 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:33081
I20260807 22:47:49.187068 17485 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:49.189512 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 17485
I20260807 22:47:49.189641 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:49.189976 12739 external_mini_cluster.cc:1428] Setting key 8e9824f21c88d3da3ec78f309c86f20d
I20260807 22:47:49.190788 17555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:49.195698 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.191542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54018 (local address 127.12.112.254:33081)
0807 22:47:49.192201 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.192216 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.192251 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:47:49.192926 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.192941 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.193279 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.193622 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.194450 (+ 828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.194455 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.194467 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.194476 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.194529 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.194545 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.194704 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.194778 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.195020 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":150,"threads_started":1}
I20260807 22:47:49.197481 17555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79: Bootstrap starting.
I20260807 22:47:49.199808 17555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:49.200666 17555 log.cc:824] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:49.202739 17555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79: No bootstrap required, opened a new log
I20260807 22:47:49.206449 17555 raft_consensus.cc:348] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478350e7c5db4ac3ab271a4014fced79" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33081 } }
I20260807 22:47:49.206670 17555 raft_consensus.cc:374] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:49.206712 17555 raft_consensus.cc:729] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 478350e7c5db4ac3ab271a4014fced79, State: Initialized, Role: FOLLOWER
I20260807 22:47:49.207129 17555 consensus_queue.cc:260] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478350e7c5db4ac3ab271a4014fced79" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33081 } }
I20260807 22:47:49.207304 17555 raft_consensus.cc:388] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:49.207387 17555 raft_consensus.cc:482] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:49.207499 17555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:49.208395 17555 raft_consensus.cc:504] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478350e7c5db4ac3ab271a4014fced79" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33081 } }
I20260807 22:47:49.208676 17555 leader_election.cc:302] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 478350e7c5db4ac3ab271a4014fced79; no voters:
I20260807 22:47:49.208940 17555 leader_election.cc:288] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:49.209149 17560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:49.209448 17560 raft_consensus.cc:686] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [term 1 LEADER]: Becoming Leader. State: Replica: 478350e7c5db4ac3ab271a4014fced79, State: Running, Role: LEADER
I20260807 22:47:49.209744 17560 consensus_queue.cc:237] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478350e7c5db4ac3ab271a4014fced79" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33081 } }
I20260807 22:47:49.210192 17555 sys_catalog.cc:564] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:49.211406 17561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "478350e7c5db4ac3ab271a4014fced79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478350e7c5db4ac3ab271a4014fced79" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33081 } } }
I20260807 22:47:49.211551 17561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:49.211870 17562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 478350e7c5db4ac3ab271a4014fced79. Latest consensus state: current_term: 1 leader_uuid: "478350e7c5db4ac3ab271a4014fced79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478350e7c5db4ac3ab271a4014fced79" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33081 } } }
I20260807 22:47:49.211977 17562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:49.212741 17569 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:49.215487 17569 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:49.220649 17569 catalog_manager.cc:1347] Generated new cluster ID: 6e1b0b600f6d49b8b1787213378bf88c
I20260807 22:47:49.220718 17569 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:49.240774 17569 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:49.241355 17569 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:49.244867 17569 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79: Generated new TSK 0
I20260807 22:47:49.245549 17569 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:47:49.253026 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33081
--builtin_ntp_servers=127.12.112.212:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 22:47:49.375433 17579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:49.375712 17579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:49.375754 17579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:49.380090 17579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:49.380146 17579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:49.380203 17579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:49.384887 17579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:49.385989 17579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:49.387480 17579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:49.397363 17589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:49.397433 17579 server_base.cc:1034] running on GCE node
W20260807 22:47:49.397364 17587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:49.397363 17585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:49.397996 17579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:49.398774 17579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:49.399948 17579 hybrid_clock.cc:648] HybridClock initialized: now 1786142869399929 us; error 33 us; skew 500 ppm
I20260807 22:47:49.401780 17579 webserver.cc:460] Webserver started at http://127.12.112.193:37359/ using document root <none> and password file <none>
I20260807 22:47:49.402426 17579 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:49.402499 17579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:49.402736 17579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:49.404814 17579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "557cd6e37e544dce8c5ba62cd0417147"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "d1cf30ca75ab18db854edd1210f4057e"
server_key_iv: "4fecf45b34ea898d10e0dc5b738f7f78"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.405413 17579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "557cd6e37e544dce8c5ba62cd0417147"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "d1cf30ca75ab18db854edd1210f4057e"
server_key_iv: "4fecf45b34ea898d10e0dc5b738f7f78"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.409160 17579 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:47:49.412019 17595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:49.413324 17579 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:49.413465 17579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "557cd6e37e544dce8c5ba62cd0417147"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "d1cf30ca75ab18db854edd1210f4057e"
server_key_iv: "4fecf45b34ea898d10e0dc5b738f7f78"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.413600 17579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:49.418166 17579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:49.418823 17579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:49.419008 17579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:49.419552 17579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:49.420468 17579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:49.420538 17579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:49.420609 17579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:49.420661 17579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:49.429361 17579 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:37591
I20260807 22:47:49.429380 17711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:37591 every 8 connection(s)
I20260807 22:47:49.430359 17579 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:49.430621 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 17579
I20260807 22:47:49.430738 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:49.431077 12739 external_mini_cluster.cc:1428] Setting key fbe51ae05f8132f1af64f7383ade2f54
I20260807 22:47:49.433326 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33081
--builtin_ntp_servers=127.12.112.212:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 22:47:49.437994 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.433123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:60505 (local address 127.12.112.254:33081)
0807 22:47:49.433258 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.433261 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.434615 (+ 1354us) server_negotiation.cc:407] Connection header received
0807 22:47:49.436063 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.436067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.436109 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.436197 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.437363 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.437371 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.437377 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.437394 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.437422 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.437435 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.437541 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.437741 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.437794 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:47:49.438787 17714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.433678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33081 (local address 127.12.112.193:60505)
0807 22:47:49.434464 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.434506 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:49.435846 (+ 1340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:49.436361 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:49.436368 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:49.436455 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:49.437083 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:47:49.437085 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:49.437125 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:47:49.437192 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:49.437558 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:49.437571 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:49.437576 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:47:49.437732 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 22:47:49.437928 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":157,"threads_started":1}
I20260807 22:47:49.440056 17712 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33081
I20260807 22:47:49.440318 17712 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:49.440835 17712 heartbeater.cc:511] Master 127.12.112.254:33081 requested a full tablet report, sending...
I20260807 22:47:49.442530 17519 ts_manager.cc:194] Registered new tserver with Master: 557cd6e37e544dce8c5ba62cd0417147 (127.12.112.193:37591)
W20260807 22:47:49.547616 17715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:49.547924 17715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:49.548002 17715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:49.552037 17715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:49.552121 17715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:49.552212 17715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:49.556926 17715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:49.558056 17715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:49.559477 17715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:49.569258 17723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:49.569275 17720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:49.569310 17721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:49.569635 17715 server_base.cc:1034] running on GCE node
I20260807 22:47:49.570098 17715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:49.570802 17715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:49.571969 17715 hybrid_clock.cc:648] HybridClock initialized: now 1786142869571949 us; error 32 us; skew 500 ppm
I20260807 22:47:49.573786 17715 webserver.cc:460] Webserver started at http://127.12.112.194:44955/ using document root <none> and password file <none>
I20260807 22:47:49.574436 17715 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:49.574513 17715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:49.574756 17715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:49.576861 17715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "c4c53489d7724a5792969b5aa7e02d8f"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "8bd77f23e1b5734f481101eba9b7f83a"
server_key_iv: "498cc493c99725987e6959dd3e8693a1"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.577536 17715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "c4c53489d7724a5792969b5aa7e02d8f"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "8bd77f23e1b5734f481101eba9b7f83a"
server_key_iv: "498cc493c99725987e6959dd3e8693a1"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.581396 17715 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 22:47:49.584038 17729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:49.585230 17715 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:49.585383 17715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "c4c53489d7724a5792969b5aa7e02d8f"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "8bd77f23e1b5734f481101eba9b7f83a"
server_key_iv: "498cc493c99725987e6959dd3e8693a1"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.585516 17715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:49.590147 17715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:49.590835 17715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:49.591029 17715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:49.591595 17715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:49.592533 17715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:49.592638 17715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:49.592734 17715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:49.592787 17715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:49.601701 17715 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:38703
I20260807 22:47:49.601724 17846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:38703 every 8 connection(s)
I20260807 22:47:49.602661 17715 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:49.608708 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.604488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:36529 (local address 127.12.112.254:33081)
0807 22:47:49.604650 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.604655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.605763 (+ 1108us) server_negotiation.cc:407] Connection header received
0807 22:47:49.607100 (+ 1337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.607102 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.607142 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.607220 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.608317 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.608320 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.608322 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.608334 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.608354 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.608363 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.608439 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.608562 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.608601 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 22:47:49.609541 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.604925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33081 (local address 127.12.112.194:36529)
0807 22:47:49.605614 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.605655 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:49.606912 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:49.607431 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:49.607437 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:49.607522 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:49.608066 (+ 544us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:47:49.608067 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:49.608106 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:47:49.608173 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:49.608439 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:49.608446 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:49.608450 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:47:49.608577 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 22:47:49.608759 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":118,"threads_started":1}
I20260807 22:47:49.610347 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 17715
I20260807 22:47:49.610497 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:49.610792 17847 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33081
I20260807 22:47:49.610847 12739 external_mini_cluster.cc:1428] Setting key a1fd5509cb9f5965623b2bc1839dd210
I20260807 22:47:49.611023 17847 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:49.611466 17847 heartbeater.cc:511] Master 127.12.112.254:33081 requested a full tablet report, sending...
I20260807 22:47:49.612516 17519 ts_manager.cc:194] Registered new tserver with Master: c4c53489d7724a5792969b5aa7e02d8f (127.12.112.194:38703)
I20260807 22:47:49.612882 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33081
--builtin_ntp_servers=127.12.112.212:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 22:47:49.725571 17850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:49.725857 17850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:49.725934 17850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:49.729933 17850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:49.730033 17850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:49.730129 17850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:49.734887 17850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:49.736054 17850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:49.737469 17850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:49.749765 17857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:49.749791 17858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:49.749922 17860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:49.750932 17850 server_base.cc:1034] running on GCE node
I20260807 22:47:49.751354 17850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:49.751999 17850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:49.753223 17850 hybrid_clock.cc:648] HybridClock initialized: now 1786142869753188 us; error 45 us; skew 500 ppm
I20260807 22:47:49.755250 17850 webserver.cc:460] Webserver started at http://127.12.112.195:45733/ using document root <none> and password file <none>
I20260807 22:47:49.755843 17850 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:49.755939 17850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:49.756171 17850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:49.758231 17850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "7e13a4f4d36a410ba62dd601e77328e0"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "915282f3f5c66e41427587c14036ed83"
server_key_iv: "8bce3cf5267241e8bbbb5835e14a87da"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.758876 17850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "7e13a4f4d36a410ba62dd601e77328e0"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "915282f3f5c66e41427587c14036ed83"
server_key_iv: "8bce3cf5267241e8bbbb5835e14a87da"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.762677 17850 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:47:49.765201 17866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:49.766526 17850 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:49.766641 17850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "7e13a4f4d36a410ba62dd601e77328e0"
format_stamp: "Formatted at 2026-08-07 22:47:49 on dist-test-slave-tm1g"
server_key: "915282f3f5c66e41427587c14036ed83"
server_key_iv: "8bce3cf5267241e8bbbb5835e14a87da"
server_key_version: "encryptionkey@0"
I20260807 22:47:49.766746 17850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:49.771241 17850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:49.771824 17850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:49.772002 17850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:49.772534 17850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:49.773411 17850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:49.773455 17850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:49.773516 17850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:49.773554 17850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:49.782473 17850 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:40345
I20260807 22:47:49.782541 17985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:40345 every 8 connection(s)
I20260807 22:47:49.783361 17850 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:47:49.789320 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.785175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:52431 (local address 127.12.112.254:33081)
0807 22:47:49.785321 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.785326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.786376 (+ 1050us) server_negotiation.cc:407] Connection header received
0807 22:47:49.787668 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.787671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.787708 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.787783 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.788933 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.788936 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.788938 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.788950 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.788970 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.788979 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.789059 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.789176 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.789213 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:47:49.789840 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 17850
I20260807 22:47:49.789976 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:47:49.790285 12739 external_mini_cluster.cc:1428] Setting key bb78a8d9dfec446b685fadeb6a1cc7a9
I20260807 22:47:49.790480 17988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.785577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33081 (local address 127.12.112.195:52431)
0807 22:47:49.786210 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.786250 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:49.787488 (+ 1238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:49.787935 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:49.787942 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:49.788026 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:49.788685 (+ 659us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:47:49.788687 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:49.788726 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:47:49.788790 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:49.789057 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:49.789063 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:49.789067 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:47:49.789193 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 22:47:49.789459 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":108,"threads_started":1}
I20260807 22:47:49.791545 17986 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33081
I20260807 22:47:49.791779 17986 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:49.792176 17986 heartbeater.cc:511] Master 127.12.112.254:33081 requested a full tablet report, sending...
I20260807 22:47:49.793161 17518 ts_manager.cc:194] Registered new tserver with Master: 7e13a4f4d36a410ba62dd601e77328e0 (127.12.112.195:40345)
I20260807 22:47:49.804168 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:47:49.807842 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.806092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54028 (local address 127.12.112.254:33081)
0807 22:47:49.806262 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.806267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.806443 (+ 176us) server_negotiation.cc:407] Connection header received
0807 22:47:49.806544 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.806547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.806579 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.806644 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.807407 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.807410 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.807412 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.807423 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.807441 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.807449 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.807519 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.807634 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.807668 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 22:47:49.811007 17518 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:47:49.814360 17518 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:49.826237 17997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.823059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:37591 (local address 127.0.0.1:52814)
0807 22:47:49.823759 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.823811 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:49.823939 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:49.824775 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:49.824782 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:49.824860 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:49.825458 (+ 598us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:47:49.825460 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:49.825477 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:47:49.825531 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:49.825873 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:49.825887 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:49.825891 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:47:49.825996 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 22:47:49.826068 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":93,"threads_started":1}
I20260807 22:47:49.826256 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.823240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52814 (local address 127.12.112.193:37591)
0807 22:47:49.823621 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.823635 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.824309 (+ 674us) server_negotiation.cc:407] Connection header received
0807 22:47:49.824378 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.824383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.824606 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.824754 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.825667 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.825672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.825684 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.825698 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.825743 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.825780 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.825900 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.825998 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.826078 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":143,"threads_started":1}
I20260807 22:47:49.826979 17999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.823784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:38703 (local address 127.0.0.1:47862)
0807 22:47:49.824389 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.824403 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:49.824475 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:49.825789 (+ 1314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:49.825792 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:49.825811 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:49.826237 (+ 426us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:47:49.826238 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:49.826250 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:47:49.826281 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:49.826713 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:49.826716 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:49.826719 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:47:49.826799 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:47:49.826834 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":111,"threads_started":1}
I20260807 22:47:49.827014 18001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.824009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47862 (local address 127.12.112.194:38703)
0807 22:47:49.824727 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.824739 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.824762 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:47:49.824811 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.824815 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.825061 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.825196 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.826452 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.826457 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.826467 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.826486 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.826521 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.826546 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.826663 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.826841 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.826901 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":112,"threads_started":1}
I20260807 22:47:49.828951 18000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.823319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:40345 (local address 127.0.0.1:40532)
0807 22:47:49.824035 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.824048 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:49.824136 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:49.827930 (+ 3794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:49.827933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:49.827949 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:49.828358 (+ 409us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:47:49.828360 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:49.828370 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:47:49.828398 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:49.828711 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:49.828714 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:49.828718 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:47:49.828798 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:47:49.828837 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":132,"threads_started":1}
I20260807 22:47:49.829061 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.824248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40532 (local address 127.12.112.195:40345)
0807 22:47:49.826187 (+ 1939us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.827451 (+ 1264us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.827479 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:47:49.827534 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.827539 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.827695 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.827956 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.828557 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.828566 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.828573 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.828581 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.828608 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.828623 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.828738 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.828831 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.828895 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1789,"thread_start_us":169,"threads_started":1}
I20260807 22:47:49.829632 17643 tablet_service.cc:1467] Processing CreateTablet for tablet b9b0f9e4d7d447b8b604c1a87fdb7eca (DEFAULT_TABLE table=test-table [id=b6e223700fce46ba90cc4671fd9a5383]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:49.829908 17780 tablet_service.cc:1467] Processing CreateTablet for tablet b9b0f9e4d7d447b8b604c1a87fdb7eca (DEFAULT_TABLE table=test-table [id=b6e223700fce46ba90cc4671fd9a5383]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:49.830835 17780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9b0f9e4d7d447b8b604c1a87fdb7eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:49.830835 17643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9b0f9e4d7d447b8b604c1a87fdb7eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:49.831300 17915 tablet_service.cc:1467] Processing CreateTablet for tablet b9b0f9e4d7d447b8b604c1a87fdb7eca (DEFAULT_TABLE table=test-table [id=b6e223700fce46ba90cc4671fd9a5383]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:49.832072 17915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9b0f9e4d7d447b8b604c1a87fdb7eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:49.837850 18003 tablet_bootstrap.cc:492] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: Bootstrap starting.
I20260807 22:47:49.838585 18004 tablet_bootstrap.cc:492] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147: Bootstrap starting.
I20260807 22:47:49.840288 18003 tablet_bootstrap.cc:654] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:49.840469 18004 tablet_bootstrap.cc:654] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:49.841063 18003 log.cc:824] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:49.841151 18004 log.cc:824] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:49.841781 18005 tablet_bootstrap.cc:492] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: Bootstrap starting.
I20260807 22:47:49.843132 18003 tablet_bootstrap.cc:492] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: No bootstrap required, opened a new log
I20260807 22:47:49.843333 18003 ts_tablet_manager.cc:1397] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:47:49.843555 18005 tablet_bootstrap.cc:654] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:49.843583 18004 tablet_bootstrap.cc:492] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147: No bootstrap required, opened a new log
I20260807 22:47:49.843745 18004 ts_tablet_manager.cc:1397] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 22:47:49.844281 18005 log.cc:824] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:49.846381 18005 tablet_bootstrap.cc:492] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: No bootstrap required, opened a new log
I20260807 22:47:49.846593 18005 ts_tablet_manager.cc:1397] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:47:49.848142 18004 raft_consensus.cc:348] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.848142 18003 raft_consensus.cc:348] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.848423 18003 raft_consensus.cc:374] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:49.848423 18004 raft_consensus.cc:374] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:49.848477 18003 raft_consensus.cc:729] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e13a4f4d36a410ba62dd601e77328e0, State: Initialized, Role: FOLLOWER
I20260807 22:47:49.848486 18004 raft_consensus.cc:729] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557cd6e37e544dce8c5ba62cd0417147, State: Initialized, Role: FOLLOWER
I20260807 22:47:49.848942 18003 consensus_queue.cc:260] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.848942 18004 consensus_queue.cc:260] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.849645 17986 heartbeater.cc:503] Master 127.12.112.254:33081 was elected leader, sending a full tablet report...
I20260807 22:47:49.849926 17712 heartbeater.cc:503] Master 127.12.112.254:33081 was elected leader, sending a full tablet report...
I20260807 22:47:49.849969 18004 ts_tablet_manager.cc:1428] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:47:49.851018 18003 ts_tablet_manager.cc:1428] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 22:47:49.852217 18005 raft_consensus.cc:348] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.852501 18005 raft_consensus.cc:374] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:49.852561 18005 raft_consensus.cc:729] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4c53489d7724a5792969b5aa7e02d8f, State: Initialized, Role: FOLLOWER
I20260807 22:47:49.853031 18005 consensus_queue.cc:260] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.853911 18005 ts_tablet_manager.cc:1428] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:47:49.854272 17847 heartbeater.cc:503] Master 127.12.112.254:33081 was elected leader, sending a full tablet report...
I20260807 22:47:49.908339 18009 raft_consensus.cc:482] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:49.908617 18009 raft_consensus.cc:504] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.910209 18009 leader_election.cc:288] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e13a4f4d36a410ba62dd601e77328e0 (127.12.112.195:40345), c4c53489d7724a5792969b5aa7e02d8f (127.12.112.194:38703)
I20260807 22:47:49.912346 18011 raft_consensus.cc:482] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:49.912570 18011 raft_consensus.cc:504] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.912772 17714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.910526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:40345 (local address 127.12.112.193:54101)
0807 22:47:49.910675 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.910694 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:49.910791 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:49.911608 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:49.911612 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:49.911628 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:49.912139 (+ 511us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:47:49.912144 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:49.912158 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:47:49.912191 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:49.912478 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:49.912483 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:49.912489 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:47:49.912574 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 22:47:49.912617 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 22:47:49.913153 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.910629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:54101 (local address 127.12.112.195:40345)
0807 22:47:49.911360 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.911364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.911393 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:47:49.911448 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.911451 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.911495 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.911590 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.912315 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.912320 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.912325 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.912340 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.912365 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.912378 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.912483 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.912942 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.913001 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640}
I20260807 22:47:49.913730 18001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.911006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:44281 (local address 127.12.112.194:38703)
0807 22:47:49.911158 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.911165 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.911533 (+ 368us) server_negotiation.cc:407] Connection header received
0807 22:47:49.911599 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.911602 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.911638 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.911716 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.913090 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.913093 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.913096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.913107 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.913131 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.913143 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.913204 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.913561 (+ 357us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.913602 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:47:49.913846 18011 leader_election.cc:288] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 557cd6e37e544dce8c5ba62cd0417147 (127.12.112.193:37591), 7e13a4f4d36a410ba62dd601e77328e0 (127.12.112.195:40345)
I20260807 22:47:49.914592 18012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.910875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:38703 (local address 127.12.112.193:44281)
0807 22:47:49.911302 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.911319 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:49.911413 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:49.911823 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:49.911828 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:49.911846 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:49.912646 (+ 800us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:47:49.912648 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:49.912658 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:47:49.912689 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:49.913454 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:49.913457 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:49.913460 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:47:49.914368 (+ 908us) client_negotiation.cc:240] Negotiation successful
0807 22:47:49.914413 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":162,"threads_started":1}
I20260807 22:47:49.914670 17937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b0f9e4d7d447b8b604c1a87fdb7eca" candidate_uuid: "557cd6e37e544dce8c5ba62cd0417147" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e13a4f4d36a410ba62dd601e77328e0" is_pre_election: true
I20260807 22:47:49.915030 17937 raft_consensus.cc:2454] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 557cd6e37e544dce8c5ba62cd0417147 in term 0.
I20260807 22:47:49.915709 17598 leader_election.cc:302] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 557cd6e37e544dce8c5ba62cd0417147, 7e13a4f4d36a410ba62dd601e77328e0; no voters:
I20260807 22:47:49.916049 18009 raft_consensus.cc:2781] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:49.916131 18009 raft_consensus.cc:482] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:49.916064 17800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b0f9e4d7d447b8b604c1a87fdb7eca" candidate_uuid: "557cd6e37e544dce8c5ba62cd0417147" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4c53489d7724a5792969b5aa7e02d8f" is_pre_election: true
I20260807 22:47:49.916180 18009 raft_consensus.cc:3037] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:49.916275 17800 raft_consensus.cc:2454] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 557cd6e37e544dce8c5ba62cd0417147 in term 0.
I20260807 22:47:49.916500 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.914555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:40607 (local address 127.12.112.195:40345)
0807 22:47:49.914734 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.914738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.915118 (+ 380us) server_negotiation.cc:407] Connection header received
0807 22:47:49.915268 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.915271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.915305 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.915392 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.916045 (+ 653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.916051 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.916056 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.916068 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.916089 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.916098 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.916159 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.916349 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.916389 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:47:49.917248 18013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.914116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:40345 (local address 127.12.112.194:40607)
0807 22:47:49.915033 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.915046 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:49.915166 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:49.915445 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:49.915449 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:49.915466 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:49.915866 (+ 400us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:47:49.915868 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:49.915888 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:47:49.915914 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:49.916239 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:49.916242 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:49.916245 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:47:49.916973 (+ 728us) client_negotiation.cc:240] Negotiation successful
0807 22:47:49.917010 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":846,"thread_start_us":120,"threads_started":1}
I20260807 22:47:49.917411 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.914046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:37591 (local address 127.12.112.194:34073)
0807 22:47:49.914177 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.914189 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:49.914254 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:49.915302 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:49.915305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:49.915317 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:49.916821 (+ 1504us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:47:49.916823 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:49.916834 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:47:49.916859 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:49.917192 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:49.917195 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:49.917199 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:47:49.917274 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 22:47:49.917309 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 22:47:49.917691 17937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b0f9e4d7d447b8b604c1a87fdb7eca" candidate_uuid: "c4c53489d7724a5792969b5aa7e02d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e13a4f4d36a410ba62dd601e77328e0" is_pre_election: true
I20260807 22:47:49.917800 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.914963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:34073 (local address 127.12.112.193:37591)
0807 22:47:49.915074 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.915081 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.915095 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:47:49.915132 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.915137 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.915167 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.915236 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.916997 (+ 1761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.917018 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.917021 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.917032 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.917050 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.917059 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.917133 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.917648 (+ 515us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.917691 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:47:49.917811 17937 raft_consensus.cc:2454] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4c53489d7724a5792969b5aa7e02d8f in term 0.
I20260807 22:47:49.918272 17666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b0f9e4d7d447b8b604c1a87fdb7eca" candidate_uuid: "c4c53489d7724a5792969b5aa7e02d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557cd6e37e544dce8c5ba62cd0417147" is_pre_election: true
I20260807 22:47:49.918354 17732 leader_election.cc:302] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e13a4f4d36a410ba62dd601e77328e0, c4c53489d7724a5792969b5aa7e02d8f; no voters:
I20260807 22:47:49.918488 18009 raft_consensus.cc:504] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.918646 18011 raft_consensus.cc:2781] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:49.918748 18011 raft_consensus.cc:482] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:49.918794 18011 raft_consensus.cc:3037] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:49.918807 17666 raft_consensus.cc:2379] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4c53489d7724a5792969b5aa7e02d8f in current term 1: Already voted for candidate 557cd6e37e544dce8c5ba62cd0417147 in this term.
I20260807 22:47:49.920071 18009 leader_election.cc:288] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [CANDIDATE]: Term 1 election: Requested vote from peers 7e13a4f4d36a410ba62dd601e77328e0 (127.12.112.195:40345), c4c53489d7724a5792969b5aa7e02d8f (127.12.112.194:38703)
I20260807 22:47:49.920102 18011 raft_consensus.cc:504] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.920450 17937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b0f9e4d7d447b8b604c1a87fdb7eca" candidate_uuid: "557cd6e37e544dce8c5ba62cd0417147" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e13a4f4d36a410ba62dd601e77328e0"
I20260807 22:47:49.920486 17800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b0f9e4d7d447b8b604c1a87fdb7eca" candidate_uuid: "557cd6e37e544dce8c5ba62cd0417147" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4c53489d7724a5792969b5aa7e02d8f"
I20260807 22:47:49.920552 17937 raft_consensus.cc:3037] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:49.920668 17800 raft_consensus.cc:2379] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 557cd6e37e544dce8c5ba62cd0417147 in current term 1: Already voted for candidate c4c53489d7724a5792969b5aa7e02d8f in this term.
I20260807 22:47:49.921157 18011 leader_election.cc:288] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [CANDIDATE]: Term 1 election: Requested vote from peers 557cd6e37e544dce8c5ba62cd0417147 (127.12.112.193:37591), 7e13a4f4d36a410ba62dd601e77328e0 (127.12.112.195:40345)
I20260807 22:47:49.921247 17666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b0f9e4d7d447b8b604c1a87fdb7eca" candidate_uuid: "c4c53489d7724a5792969b5aa7e02d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557cd6e37e544dce8c5ba62cd0417147"
I20260807 22:47:49.921372 17666 raft_consensus.cc:2379] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c4c53489d7724a5792969b5aa7e02d8f in current term 1: Already voted for candidate 557cd6e37e544dce8c5ba62cd0417147 in this term.
I20260807 22:47:49.921536 17936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b0f9e4d7d447b8b604c1a87fdb7eca" candidate_uuid: "c4c53489d7724a5792969b5aa7e02d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e13a4f4d36a410ba62dd601e77328e0"
I20260807 22:47:49.921983 17937 raft_consensus.cc:2454] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557cd6e37e544dce8c5ba62cd0417147 in term 1.
I20260807 22:47:49.922043 17732 leader_election.cc:302] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4c53489d7724a5792969b5aa7e02d8f; no voters: 557cd6e37e544dce8c5ba62cd0417147, 7e13a4f4d36a410ba62dd601e77328e0
I20260807 22:47:49.922184 18011 raft_consensus.cc:2726] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 22:47:49.922250 17598 leader_election.cc:302] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 557cd6e37e544dce8c5ba62cd0417147, 7e13a4f4d36a410ba62dd601e77328e0; no voters: c4c53489d7724a5792969b5aa7e02d8f
I20260807 22:47:49.922479 18009 raft_consensus.cc:2781] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:49.922683 18009 raft_consensus.cc:686] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [term 1 LEADER]: Becoming Leader. State: Replica: 557cd6e37e544dce8c5ba62cd0417147, State: Running, Role: LEADER
I20260807 22:47:49.922995 18009 consensus_queue.cc:237] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } }
I20260807 22:47:49.926250 17518 catalog_manager.cc:5495] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 reported cstate change: term changed from 0 to 1, leader changed from <none> to 557cd6e37e544dce8c5ba62cd0417147 (127.12.112.193). New cstate: current_term: 1 leader_uuid: "557cd6e37e544dce8c5ba62cd0417147" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557cd6e37e544dce8c5ba62cd0417147" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 } health_report { overall_health: UNKNOWN } } }
W20260807 22:47:49.931519 17713 tablet.cc:2369] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:47:49.949800 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.948456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52830 (local address 127.12.112.193:37591)
0807 22:47:49.948587 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:49.948591 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:49.948603 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:47:49.948679 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:49.948681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:49.948739 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:49.948811 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:49.949445 (+ 634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:49.949448 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:49.949450 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:49.949461 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:49.949480 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:49.949488 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:49.949559 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:49.949619 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 22:47:49.949660 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:47:49.955646 17800 raft_consensus.cc:1261] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 1 FOLLOWER]: Refusing update from remote peer 557cd6e37e544dce8c5ba62cd0417147: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:49.955646 17937 raft_consensus.cc:1261] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [term 1 FOLLOWER]: Refusing update from remote peer 557cd6e37e544dce8c5ba62cd0417147: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:49.956331 18009 consensus_queue.cc:1035] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4c53489d7724a5792969b5aa7e02d8f" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:49.956574 18014 consensus_queue.cc:1035] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 557cd6e37e544dce8c5ba62cd0417147 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e13a4f4d36a410ba62dd601e77328e0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 40345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:49.966082 18018 mvcc.cc:205] Tried to move back new op lower bound from 7316041195330682880 to 7316041195206946816. Current Snapshot: MvccSnapshot[applied={T|T < 7316041195330682880}]
I20260807 22:47:49.974191 17517 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:49.974464 17517 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:49.976887 17517 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 478350e7c5db4ac3ab271a4014fced79: Sending DeleteTablet for 3 replicas of tablet b9b0f9e4d7d447b8b604c1a87fdb7eca
I20260807 22:47:49.977795 17643 tablet_service.cc:1514] Processing DeleteTablet for tablet b9b0f9e4d7d447b8b604c1a87fdb7eca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:49 UTC) from {username='slave'} at 127.0.0.1:52814
I20260807 22:47:49.977839 17780 tablet_service.cc:1514] Processing DeleteTablet for tablet b9b0f9e4d7d447b8b604c1a87fdb7eca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:49 UTC) from {username='slave'} at 127.0.0.1:47862
I20260807 22:47:49.977852 17915 tablet_service.cc:1514] Processing DeleteTablet for tablet b9b0f9e4d7d447b8b604c1a87fdb7eca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:49 UTC) from {username='slave'} at 127.0.0.1:40532
I20260807 22:47:49.978364 18030 tablet_replica.cc:330] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: stopping tablet replica
I20260807 22:47:49.978637 18029 tablet_replica.cc:330] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: stopping tablet replica
I20260807 22:47:49.978964 18029 raft_consensus.cc:2229] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:49.979122 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 17579
I20260807 22:47:49.983112 18029 raft_consensus.cc:2258] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:49.983274 18030 raft_consensus.cc:2229] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:49.983613 18030 raft_consensus.cc:2258] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:49.984755 18029 ts_tablet_manager.cc:1905] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:49.985108 18030 ts_tablet_manager.cc:1905] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:49.987121 18029 ts_tablet_manager.cc:1918] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:47:49.987236 18029 log.cc:1196] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/b9b0f9e4d7d447b8b604c1a87fdb7eca
I20260807 22:47:49.987563 18029 ts_tablet_manager.cc:1939] T b9b0f9e4d7d447b8b604c1a87fdb7eca P c4c53489d7724a5792969b5aa7e02d8f: Deleting consensus metadata
I20260807 22:47:49.988608 18030 ts_tablet_manager.cc:1918] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:47:49.988709 18030 log.cc:1196] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/b9b0f9e4d7d447b8b604c1a87fdb7eca
I20260807 22:47:49.988741 17503 catalog_manager.cc:4841] TS c4c53489d7724a5792969b5aa7e02d8f (127.12.112.194:38703): tablet b9b0f9e4d7d447b8b604c1a87fdb7eca (table test-table [id=b6e223700fce46ba90cc4671fd9a5383]) successfully deleted
I20260807 22:47:49.989061 18030 ts_tablet_manager.cc:1939] T b9b0f9e4d7d447b8b604c1a87fdb7eca P 7e13a4f4d36a410ba62dd601e77328e0: Deleting consensus metadata
I20260807 22:47:49.990434 17503 catalog_manager.cc:4841] TS 7e13a4f4d36a410ba62dd601e77328e0 (127.12.112.195:40345): tablet b9b0f9e4d7d447b8b604c1a87fdb7eca (table test-table [id=b6e223700fce46ba90cc4671fd9a5383]) successfully deleted
W20260807 22:47:49.990556 17504 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:37591 (error 108)
I20260807 22:47:49.990744 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 17715
I20260807 22:47:49.994937 18000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:49.994560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:37591 (local address 127.0.0.1:52840)
0807 22:47:49.994733 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:49.994824 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:37591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 22:47:49.995126 17504 catalog_manager.cc:4584] TS 557cd6e37e544dce8c5ba62cd0417147 (127.12.112.193:37591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b9b0f9e4d7d447b8b604c1a87fdb7eca: Network error: Client connection negotiation failed: client connection to 127.12.112.193:37591: connect: Connection refused (error 111)
I20260807 22:47:49.998196 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 17850
I20260807 22:47:50.005475 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 17485
2026-08-07T22:47:50Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1013 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 22:47:50.029268 12739 mini_oidc.cc:152] Starting JWKS server
I20260807 22:47:50.031157 12739 webserver.cc:460] Webserver started at https://127.0.0.1:45917/ using document root <none> and password file <none>
I20260807 22:47:50.031358 12739 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 22:47:50.031647 12739 webserver.cc:460] Webserver started at http://127.0.0.1:44635/ using document root <none> and password file <none>
2026-08-07T22:47:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:50Z Disabled control of system clock
I20260807 22:47:50.041628 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33485
--webserver_interface=127.12.112.254
--webserver_port=0
--builtin_ntp_servers=127.12.112.212:41525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:33485
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45917/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/testchainca.cert with env {}
W20260807 22:47:50.154517 18037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:50.154799 18037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:50.154838 18037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:50.158944 18037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:50.159008 18037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:50.159024 18037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:50.159044 18037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:50.159058 18037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:47:50.159075 18037 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:47:50.159087 18037 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45917/jwks.json
I20260807 22:47:50.164557 18037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:41525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:33485
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45917/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:50.165681 18037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:50.166806 18037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:50.175429 18042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:50.175554 18037 server_base.cc:1034] running on GCE node
W20260807 22:47:50.175429 18045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:50.175729 18043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:50.176378 18037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:50.177488 18037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:50.178654 18037 hybrid_clock.cc:648] HybridClock initialized: now 1786142870178625 us; error 41 us; skew 500 ppm
I20260807 22:47:50.180631 18037 webserver.cc:460] Webserver started at http://127.12.112.254:43777/ using document root <none> and password file <none>
I20260807 22:47:50.181226 18037 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:50.181289 18037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:50.181535 18037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:50.183717 18037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "e18847f290e845e0b1ac5bcd24dc8b29"
format_stamp: "Formatted at 2026-08-07 22:47:50 on dist-test-slave-tm1g"
server_key: "8436e26d1c33c2e35dea26635bc52622"
server_key_iv: "baea22045abd708c682cab8324941d52"
server_key_version: "encryptionkey@0"
I20260807 22:47:50.184392 18037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "e18847f290e845e0b1ac5bcd24dc8b29"
format_stamp: "Formatted at 2026-08-07 22:47:50 on dist-test-slave-tm1g"
server_key: "8436e26d1c33c2e35dea26635bc52622"
server_key_iv: "baea22045abd708c682cab8324941d52"
server_key_version: "encryptionkey@0"
I20260807 22:47:50.188259 18037 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:47:50.190837 18051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:50.192094 18037 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:50.192239 18037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "e18847f290e845e0b1ac5bcd24dc8b29"
format_stamp: "Formatted at 2026-08-07 22:47:50 on dist-test-slave-tm1g"
server_key: "8436e26d1c33c2e35dea26635bc52622"
server_key_iv: "baea22045abd708c682cab8324941d52"
server_key_version: "encryptionkey@0"
I20260807 22:47:50.192356 18037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:50.219448 18037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:50.220208 18037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:50.220423 18037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:50.227538 18037 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:33485
I20260807 22:47:50.227577 18106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:33485 every 8 connection(s)
I20260807 22:47:50.228543 18037 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:50.231773 18108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:50.237314 18108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29: Bootstrap starting.
I20260807 22:47:50.237929 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 18037
I20260807 22:47:50.238039 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:50.238368 12739 external_mini_cluster.cc:1428] Setting key ae1cc8473619e8c977c00c4971ef0c08
I20260807 22:47:50.240221 18108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:50.240980 18108 log.cc:824] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:50.243022 18108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29: No bootstrap required, opened a new log
I20260807 22:47:50.246490 18108 raft_consensus.cc:348] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18847f290e845e0b1ac5bcd24dc8b29" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33485 } }
I20260807 22:47:50.246745 18108 raft_consensus.cc:374] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:50.246809 18108 raft_consensus.cc:729] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e18847f290e845e0b1ac5bcd24dc8b29, State: Initialized, Role: FOLLOWER
I20260807 22:47:50.247275 18108 consensus_queue.cc:260] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18847f290e845e0b1ac5bcd24dc8b29" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33485 } }
I20260807 22:47:50.247430 18108 raft_consensus.cc:388] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:50.247520 18108 raft_consensus.cc:482] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:50.247646 18108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:50.247826 18111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:50.239660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53938 (local address 127.12.112.254:33485)
0807 22:47:50.240314 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:50.240358 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:50.240410 (+ 52us) server_negotiation.cc:407] Connection header received
0807 22:47:50.241027 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:50.241044 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:50.241558 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:50.241935 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:50.242418 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.243444 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.244349 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.244834 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.245029 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:50.245899 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:50.245904 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:50.245916 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:50.246353 (+ 437us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:50.246421 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:50.246442 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:50.246550 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:50.246670 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 22:47:50.246962 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":132,"threads_started":1}
I20260807 22:47:50.248809 18108 raft_consensus.cc:504] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18847f290e845e0b1ac5bcd24dc8b29" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33485 } }
I20260807 22:47:50.249150 18108 leader_election.cc:302] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e18847f290e845e0b1ac5bcd24dc8b29; no voters:
I20260807 22:47:50.249500 18108 leader_election.cc:288] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:50.249876 18113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:50.250078 18113 raft_consensus.cc:686] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [term 1 LEADER]: Becoming Leader. State: Replica: e18847f290e845e0b1ac5bcd24dc8b29, State: Running, Role: LEADER
I20260807 22:47:50.250402 18113 consensus_queue.cc:237] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18847f290e845e0b1ac5bcd24dc8b29" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33485 } }
I20260807 22:47:50.250814 18108 sys_catalog.cc:564] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:50.250864 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:47:50.251608 18115 sys_catalog.cc:455] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e18847f290e845e0b1ac5bcd24dc8b29. Latest consensus state: current_term: 1 leader_uuid: "e18847f290e845e0b1ac5bcd24dc8b29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18847f290e845e0b1ac5bcd24dc8b29" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33485 } } }
I20260807 22:47:50.251725 18115 sys_catalog.cc:458] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:50.252386 18114 sys_catalog.cc:455] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e18847f290e845e0b1ac5bcd24dc8b29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18847f290e845e0b1ac5bcd24dc8b29" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33485 } } }
I20260807 22:47:50.252501 18114 sys_catalog.cc:458] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29 [sys.catalog]: This master's current role is: LEADER
W20260807 22:47:50.255492 18129 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:47:50.255558 18129 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:47:50.255643 18122 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:50.256348 18122 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:50.261721 18122 catalog_manager.cc:1347] Generated new cluster ID: 54d55326f647426580173ac3bae0bb58
I20260807 22:47:50.261788 18122 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:50.267697 18122 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:50.268567 18122 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:50.273857 18122 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e18847f290e845e0b1ac5bcd24dc8b29: Generated new TSK 0
I20260807 22:47:50.274574 18122 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 22:47:50.305030 18139 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 22:47:50.305199 18139 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 22:47:50.305809 18111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:50.287812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53952 (local address 127.12.112.254:33485)
0807 22:47:50.287956 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:50.287960 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:50.288135 (+ 175us) server_negotiation.cc:407] Connection header received
0807 22:47:50.288336 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:50.288340 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:50.288402 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:50.288522 (+ 120us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:47:50.288762 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.289635 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.290617 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.290986 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.291098 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:50.291450 (+ 352us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:47:50.305383 (+ 13933us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45917/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 22:47:50.305665 (+ 282us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53952: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45917/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":66}
W20260807 22:47:50.305907 18111 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53952: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45917/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 22:47:50.307024 18138 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:47:50.287698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33485 (local address 127.0.0.1:53952)
0807 22:47:50.288043 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:50.288056 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:50.288168 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:50.288537 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:50.288539 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:50.288547 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:47:50.288646 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:50.288651 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.289755 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.289757 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:50.290495 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:50.290505 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.291109 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.291111 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:50.291185 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:50.291231 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:47:50.305611 (+ 14380us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45917/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 22:47:50.305811 (+ 200us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.112.254:33485: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45917/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":116,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.112.254:33485: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45917/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 22:47:50.307952 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 18037
2026-08-07T22:47:50Z chronyd exiting
I20260807 22:47:50.347651 12739 test_util.cc:175] -----------------------------------------------
I20260807 22:47:50.347745 12739 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142843719124-12739-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (320 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 22:47:50.348934 12739 mini_oidc.cc:152] Starting JWKS server
I20260807 22:47:50.349857 12739 webserver.cc:460] Webserver started at https://127.0.0.1:37761/ using document root <none> and password file <none>
I20260807 22:47:50.349974 12739 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 22:47:50.350265 12739 webserver.cc:460] Webserver started at http://127.0.0.1:42939/ using document root <none> and password file <none>
2026-08-07T22:47:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:50Z Disabled control of system clock
I20260807 22:47:50.360239 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:45909
--webserver_interface=127.12.112.254
--webserver_port=0
--builtin_ntp_servers=127.12.112.212:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:45909
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37761/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/testchainca.cert with env {}
W20260807 22:47:50.474582 18145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:50.474858 18145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:50.474900 18145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:50.478927 18145 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:50.478993 18145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:50.479008 18145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:50.479025 18145 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:50.479041 18145 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:47:50.479058 18145 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:47:50.479071 18145 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37761/jwks.json
I20260807 22:47:50.484514 18145 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:45909
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:45909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37761/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:50.485598 18145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:50.486668 18145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:47:50.495319 18145 server_base.cc:1034] running on GCE node
W20260807 22:47:50.495237 18150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:50.495244 18151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:50.495244 18153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:50.496146 18145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:50.497267 18145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:50.498437 18145 hybrid_clock.cc:648] HybridClock initialized: now 1786142870498407 us; error 44 us; skew 500 ppm
I20260807 22:47:50.500361 18145 webserver.cc:460] Webserver started at http://127.12.112.254:43075/ using document root <none> and password file <none>
I20260807 22:47:50.500936 18145 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:50.501029 18145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:50.501259 18145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:50.503382 18145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "920de7b94b7447a3a57de32426d386c5"
format_stamp: "Formatted at 2026-08-07 22:47:50 on dist-test-slave-tm1g"
server_key: "f98dc81c5c17dc23593dfa8552e8f938"
server_key_iv: "9c381ca12a33e2677e814e5b7c2e1763"
server_key_version: "encryptionkey@0"
I20260807 22:47:50.503952 18145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "920de7b94b7447a3a57de32426d386c5"
format_stamp: "Formatted at 2026-08-07 22:47:50 on dist-test-slave-tm1g"
server_key: "f98dc81c5c17dc23593dfa8552e8f938"
server_key_iv: "9c381ca12a33e2677e814e5b7c2e1763"
server_key_version: "encryptionkey@0"
I20260807 22:47:50.507632 18145 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:47:50.510061 18159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:50.511305 18145 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:50.511458 18145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "920de7b94b7447a3a57de32426d386c5"
format_stamp: "Formatted at 2026-08-07 22:47:50 on dist-test-slave-tm1g"
server_key: "f98dc81c5c17dc23593dfa8552e8f938"
server_key_iv: "9c381ca12a33e2677e814e5b7c2e1763"
server_key_version: "encryptionkey@0"
I20260807 22:47:50.511581 18145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:50.526556 18145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:50.527269 18145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:50.527477 18145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:50.534420 18213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:45909 every 8 connection(s)
I20260807 22:47:50.534425 18145 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:45909
I20260807 22:47:50.535413 18145 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:50.536270 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 18145
I20260807 22:47:50.536418 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:50.536738 12739 external_mini_cluster.cc:1428] Setting key d3a7e236763df6097317d0af78c2d312
I20260807 22:47:50.539178 18215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:50.545545 18215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5: Bootstrap starting.
I20260807 22:47:50.545904 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:50.538060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40746 (local address 127.12.112.254:45909)
0807 22:47:50.538690 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:50.538706 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:50.538742 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:47:50.539442 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:50.539459 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:50.539839 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:50.540106 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:50.540430 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.541389 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.542634 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.543091 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.543207 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:50.544088 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:50.544092 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:50.544104 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:50.544494 (+ 390us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:50.544557 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:50.544577 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:50.544651 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:50.544823 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 22:47:50.545134 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":151,"threads_started":1}
I20260807 22:47:50.548062 18215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:50.548866 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:47:50.549000 18215 log.cc:824] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:50.551105 18215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5: No bootstrap required, opened a new log
I20260807 22:47:50.554557 18215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920de7b94b7447a3a57de32426d386c5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45909 } }
I20260807 22:47:50.554776 18215 raft_consensus.cc:374] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:50.554811 18215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 920de7b94b7447a3a57de32426d386c5, State: Initialized, Role: FOLLOWER
I20260807 22:47:50.555261 18215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920de7b94b7447a3a57de32426d386c5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45909 } }
I20260807 22:47:50.555392 18215 raft_consensus.cc:388] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:50.555486 18215 raft_consensus.cc:482] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:50.555599 18215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:50.556515 18215 raft_consensus.cc:504] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920de7b94b7447a3a57de32426d386c5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45909 } }
I20260807 22:47:50.556842 18215 leader_election.cc:302] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 920de7b94b7447a3a57de32426d386c5; no voters:
I20260807 22:47:50.557143 18215 leader_election.cc:288] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:50.557278 18221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:50.557530 18221 raft_consensus.cc:686] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [term 1 LEADER]: Becoming Leader. State: Replica: 920de7b94b7447a3a57de32426d386c5, State: Running, Role: LEADER
I20260807 22:47:50.557842 18221 consensus_queue.cc:237] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920de7b94b7447a3a57de32426d386c5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45909 } }
I20260807 22:47:50.558467 18215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:50.559710 18222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "920de7b94b7447a3a57de32426d386c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920de7b94b7447a3a57de32426d386c5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45909 } } }
I20260807 22:47:50.559728 18224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 920de7b94b7447a3a57de32426d386c5. Latest consensus state: current_term: 1 leader_uuid: "920de7b94b7447a3a57de32426d386c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920de7b94b7447a3a57de32426d386c5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45909 } } }
I20260807 22:47:50.559849 18222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:50.559867 18224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:50.560278 18232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:50.563506 18232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:50.568912 18232 catalog_manager.cc:1347] Generated new cluster ID: dfd9ae3ed1094f8f98207216fa9930cb
I20260807 22:47:50.569020 18232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:50.577353 18232 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:50.578606 18232 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:50.583463 18232 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 920de7b94b7447a3a57de32426d386c5: Generated new TSK 0
I20260807 22:47:50.584231 18232 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 22:47:50.611462 18248 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 22:47:50.611562 18248 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 22:47:50.612214 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:50.596269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40752 (local address 127.12.112.254:45909)
0807 22:47:50.596421 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:50.596426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:50.596616 (+ 190us) server_negotiation.cc:407] Connection header received
0807 22:47:50.596778 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:50.596780 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:50.596827 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:50.596916 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:47:50.597192 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.597712 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.598993 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.599287 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.599379 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:50.599728 (+ 349us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:47:50.611871 (+ 12143us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37761/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 22:47:50.612099 (+ 228us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40752: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37761/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 22:47:50.612310 18219 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40752: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37761/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 22:47:50.612473 18247 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:47:50.596173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:45909 (local address 127.0.0.1:40752)
0807 22:47:50.596521 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:50.596537 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:50.596654 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:50.596947 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:50.596950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:50.596958 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:47:50.597085 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:50.597092 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.597823 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.597827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:50.598860 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:50.598871 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.599420 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.599424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:50.599533 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:50.599562 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:47:50.612079 (+ 12517us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37761/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 22:47:50.612280 (+ 201us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.112.254:45909: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37761/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":108,"threads_started":1}
I20260807 22:47:50.613149 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 18145
2026-08-07T22:47:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (305 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 22:47:50.654793 12739 mini_oidc.cc:152] Starting JWKS server
I20260807 22:47:50.655695 12739 webserver.cc:460] Webserver started at https://127.0.0.1:39029/ using document root <none> and password file <none>
I20260807 22:47:50.655824 12739 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 22:47:50.656097 12739 webserver.cc:460] Webserver started at http://127.0.0.1:43119/ using document root <none> and password file <none>
2026-08-07T22:47:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:50Z Disabled control of system clock
I20260807 22:47:50.666023 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:42907
--webserver_interface=127.12.112.254
--webserver_port=0
--builtin_ntp_servers=127.12.112.212:36907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:42907
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39029/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 22:47:50.782150 18256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:50.782488 18256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:50.782593 18256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:50.786795 18256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:50.786872 18256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:50.786888 18256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:50.786906 18256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:50.786921 18256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:47:50.786936 18256 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:47:50.786950 18256 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39029/jwks.json
I20260807 22:47:50.792958 18256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:42907
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:42907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39029/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:50.794194 18256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:50.795718 18256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:50.805682 18262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:50.805821 18263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:50.805704 18265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:50.805946 18256 server_base.cc:1034] running on GCE node
I20260807 22:47:50.806831 18256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:50.808061 18256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:50.809283 18256 hybrid_clock.cc:648] HybridClock initialized: now 1786142870809254 us; error 44 us; skew 500 ppm
I20260807 22:47:50.811631 18256 webserver.cc:460] Webserver started at http://127.12.112.254:43259/ using document root <none> and password file <none>
I20260807 22:47:50.812265 18256 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:50.812369 18256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:50.812626 18256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:50.815032 18256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "9c90a3773bb748e8bcca535edfce2078"
format_stamp: "Formatted at 2026-08-07 22:47:50 on dist-test-slave-tm1g"
server_key: "5e02b7536f08c7cf3fadbad21dda020f"
server_key_iv: "78d3464642285984ab4d49f686cc3f7f"
server_key_version: "encryptionkey@0"
I20260807 22:47:50.815654 18256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "9c90a3773bb748e8bcca535edfce2078"
format_stamp: "Formatted at 2026-08-07 22:47:50 on dist-test-slave-tm1g"
server_key: "5e02b7536f08c7cf3fadbad21dda020f"
server_key_iv: "78d3464642285984ab4d49f686cc3f7f"
server_key_version: "encryptionkey@0"
I20260807 22:47:50.819751 18256 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:47:50.822661 18271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:50.824048 18256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:47:50.824224 18256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "9c90a3773bb748e8bcca535edfce2078"
format_stamp: "Formatted at 2026-08-07 22:47:50 on dist-test-slave-tm1g"
server_key: "5e02b7536f08c7cf3fadbad21dda020f"
server_key_iv: "78d3464642285984ab4d49f686cc3f7f"
server_key_version: "encryptionkey@0"
I20260807 22:47:50.824380 18256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:50.843389 18256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:50.844213 18256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:50.844452 18256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:50.852615 18256 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:42907
I20260807 22:47:50.852643 18324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:42907 every 8 connection(s)
I20260807 22:47:50.853689 18256 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:50.857323 18326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:50.862586 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 18256
I20260807 22:47:50.862727 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:50.863029 12739 external_mini_cluster.cc:1428] Setting key 74289d794522ede5158790f837f02825
I20260807 22:47:50.863324 18326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078: Bootstrap starting.
I20260807 22:47:50.865952 18326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:50.866783 18326 log.cc:824] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:50.868691 18326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078: No bootstrap required, opened a new log
I20260807 22:47:50.872411 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:50.864467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58834 (local address 127.12.112.254:42907)
0807 22:47:50.865174 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:50.865189 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:50.865225 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:47:50.865863 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:50.865888 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:50.866403 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:50.866743 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:50.867182 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.868151 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.869125 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.869595 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.869806 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:50.870708 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:50.870713 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:50.870725 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:50.871111 (+ 386us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:50.871164 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:50.871184 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:50.871299 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:50.871415 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 22:47:50.871675 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":150,"threads_started":1}
I20260807 22:47:50.872330 18326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c90a3773bb748e8bcca535edfce2078" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42907 } }
I20260807 22:47:50.872601 18326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:50.872694 18326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c90a3773bb748e8bcca535edfce2078, State: Initialized, Role: FOLLOWER
I20260807 22:47:50.873119 18326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c90a3773bb748e8bcca535edfce2078" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42907 } }
I20260807 22:47:50.873273 18326 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:50.873347 18326 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:50.873451 18326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:50.874459 18326 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c90a3773bb748e8bcca535edfce2078" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42907 } }
I20260807 22:47:50.874809 18326 leader_election.cc:302] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c90a3773bb748e8bcca535edfce2078; no voters:
I20260807 22:47:50.875126 18326 leader_election.cc:288] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:50.875240 18332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:50.875425 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:47:50.875481 18332 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [term 1 LEADER]: Becoming Leader. State: Replica: 9c90a3773bb748e8bcca535edfce2078, State: Running, Role: LEADER
I20260807 22:47:50.875761 18332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c90a3773bb748e8bcca535edfce2078" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42907 } }
I20260807 22:47:50.876370 18326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:50.877734 18333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c90a3773bb748e8bcca535edfce2078" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c90a3773bb748e8bcca535edfce2078" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42907 } } }
I20260807 22:47:50.877864 18333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:50.878129 18334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c90a3773bb748e8bcca535edfce2078. Latest consensus state: current_term: 1 leader_uuid: "9c90a3773bb748e8bcca535edfce2078" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c90a3773bb748e8bcca535edfce2078" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42907 } } }
I20260807 22:47:50.878243 18334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:50.878829 18342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:50.881428 18342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:50.887066 18342 catalog_manager.cc:1347] Generated new cluster ID: bdbde65df09449e392b74e757d09cdec
I20260807 22:47:50.887147 18342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:50.896317 18342 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:50.897192 18342 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:50.907413 18342 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c90a3773bb748e8bcca535edfce2078: Generated new TSK 0
I20260807 22:47:50.908152 18342 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:47:50.920399 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:50.915416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58846 (local address 127.12.112.254:42907)
0807 22:47:50.915561 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:50.915566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:50.915804 (+ 238us) server_negotiation.cc:407] Connection header received
0807 22:47:50.916015 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:50.916018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:50.916067 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:50.916183 (+ 116us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:47:50.916441 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.916999 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.917928 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.918165 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.918277 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:50.918633 (+ 356us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:47:50.920023 (+ 1390us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39029/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 22:47:50.920253 (+ 230us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58846: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39029/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 22:47:50.920470 18330 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58846: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39029/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 22:47:50.922196 18356 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:47:50.915331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42907 (local address 127.0.0.1:58846)
0807 22:47:50.915704 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:50.915716 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:50.915860 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:50.916182 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:50.916185 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:50.916193 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:47:50.916318 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:50.916325 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.917135 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.917140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:50.917796 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:50.917804 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:50.918324 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:50.918331 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:50.918421 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:50.918444 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:47:50.920193 (+ 1749us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39029/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 22:47:50.922016 (+ 1823us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.112.254:42907: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39029/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":1601,"thread_start_us":113,"threads_started":1}
I20260807 22:47:50.922739 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 18256
E20260807 22:47:50.931762 18357 webserver.cc:533] Webserver: sslize failed:
E20260807 22:47:50.931836 18357 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T22:47:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (309 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T22:47:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:50Z Disabled control of system clock
I20260807 22:47:50.973951 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:42711
--webserver_interface=127.12.112.254
--webserver_port=0
--builtin_ntp_servers=127.12.112.212:39813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:42711
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/testchainca.cert with env {}
W20260807 22:47:51.087024 18361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:51.087301 18361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:51.087371 18361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:51.091499 18361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:51.091562 18361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:51.091578 18361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:51.091594 18361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:51.091636 18361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:47:51.091672 18361 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:47:51.091699 18361 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 22:47:51.097218 18361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:39813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:42711
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:42711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:51.098387 18361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:51.099514 18361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:51.108179 18367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:51.108218 18368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:51.108594 18361 server_base.cc:1034] running on GCE node
W20260807 22:47:51.108765 18370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:51.109365 18361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:51.110567 18361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:51.111737 18361 hybrid_clock.cc:648] HybridClock initialized: now 1786142871111716 us; error 30 us; skew 500 ppm
I20260807 22:47:51.113528 18361 webserver.cc:460] Webserver started at http://127.12.112.254:42509/ using document root <none> and password file <none>
I20260807 22:47:51.114108 18361 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:51.114171 18361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:51.114492 18361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:51.116580 18361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "e85ae93b0f9f468a811a56f7747d9f6d"
format_stamp: "Formatted at 2026-08-07 22:47:51 on dist-test-slave-tm1g"
server_key: "29529b2235211fed419486be57b01a95"
server_key_iv: "43721afcd298fce8af3cb9e3c840b503"
server_key_version: "encryptionkey@0"
I20260807 22:47:51.117159 18361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "e85ae93b0f9f468a811a56f7747d9f6d"
format_stamp: "Formatted at 2026-08-07 22:47:51 on dist-test-slave-tm1g"
server_key: "29529b2235211fed419486be57b01a95"
server_key_iv: "43721afcd298fce8af3cb9e3c840b503"
server_key_version: "encryptionkey@0"
I20260807 22:47:51.120854 18361 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 22:47:51.123373 18376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:51.124771 18361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:47:51.124960 18361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "e85ae93b0f9f468a811a56f7747d9f6d"
format_stamp: "Formatted at 2026-08-07 22:47:51 on dist-test-slave-tm1g"
server_key: "29529b2235211fed419486be57b01a95"
server_key_iv: "43721afcd298fce8af3cb9e3c840b503"
server_key_version: "encryptionkey@0"
I20260807 22:47:51.125097 18361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:51.136746 18361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:51.137408 18361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:51.137614 18361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:51.144508 18361 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:42711
I20260807 22:47:51.144519 18433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:42711 every 8 connection(s)
I20260807 22:47:51.145479 18361 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:51.148277 18434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:51.150228 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 18361
I20260807 22:47:51.150372 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:51.150697 12739 external_mini_cluster.cc:1428] Setting key 0378b1081f0b35c76bbeac947d9a30bf
I20260807 22:47:51.154479 18434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d: Bootstrap starting.
I20260807 22:47:51.156649 18434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:51.157398 18434 log.cc:824] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:51.159415 18434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d: No bootstrap required, opened a new log
I20260807 22:47:51.160609 18437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:51.152159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58558 (local address 127.12.112.254:42711)
0807 22:47:51.152870 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:51.152885 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:51.152923 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:47:51.153626 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:51.153643 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:51.154057 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:51.154482 (+ 425us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:51.154946 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:51.156007 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:51.157075 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:51.157655 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:51.157842 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:51.158774 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:51.158781 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:51.158803 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:47:51.159218 (+ 415us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:51.159283 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:47:51.159305 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:51.159427 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:51.159605 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 22:47:51.159881 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":153,"threads_started":1}
I20260807 22:47:51.163160 18434 raft_consensus.cc:348] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85ae93b0f9f468a811a56f7747d9f6d" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42711 } }
I20260807 22:47:51.163417 18434 raft_consensus.cc:374] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:51.163487 18434 raft_consensus.cc:729] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e85ae93b0f9f468a811a56f7747d9f6d, State: Initialized, Role: FOLLOWER
I20260807 22:47:51.163915 18434 consensus_queue.cc:260] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85ae93b0f9f468a811a56f7747d9f6d" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42711 } }
I20260807 22:47:51.164122 18434 raft_consensus.cc:388] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:51.164163 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:47:51.164201 18434 raft_consensus.cc:482] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:51.164327 18434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:51.165359 18434 raft_consensus.cc:504] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85ae93b0f9f468a811a56f7747d9f6d" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42711 } }
I20260807 22:47:51.165714 18434 leader_election.cc:302] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e85ae93b0f9f468a811a56f7747d9f6d; no voters:
I20260807 22:47:51.166085 18434 leader_election.cc:288] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:51.166203 18439 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:51.166494 18439 raft_consensus.cc:686] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [term 1 LEADER]: Becoming Leader. State: Replica: e85ae93b0f9f468a811a56f7747d9f6d, State: Running, Role: LEADER
I20260807 22:47:51.166810 18439 consensus_queue.cc:237] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85ae93b0f9f468a811a56f7747d9f6d" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42711 } }
I20260807 22:47:51.167335 18434 sys_catalog.cc:564] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:51.168577 18440 sys_catalog.cc:455] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e85ae93b0f9f468a811a56f7747d9f6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85ae93b0f9f468a811a56f7747d9f6d" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42711 } } }
I20260807 22:47:51.168711 18440 sys_catalog.cc:458] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:51.169003 18441 sys_catalog.cc:455] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e85ae93b0f9f468a811a56f7747d9f6d. Latest consensus state: current_term: 1 leader_uuid: "e85ae93b0f9f468a811a56f7747d9f6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85ae93b0f9f468a811a56f7747d9f6d" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42711 } } }
I20260807 22:47:51.169123 18441 sys_catalog.cc:458] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d [sys.catalog]: This master's current role is: LEADER
W20260807 22:47:51.172024 18454 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:47:51.172117 18454 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:47:51.172195 18448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:51.172891 18448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:51.177753 18448 catalog_manager.cc:1347] Generated new cluster ID: 1cc3fedd2d8e4a0bbb4114b217b1b6ba
I20260807 22:47:51.177827 18448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:51.189136 18448 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:51.190078 18448 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:51.196929 18448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e85ae93b0f9f468a811a56f7747d9f6d: Generated new TSK 0
I20260807 22:47:51.197625 18448 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:47:51.639030 18437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:51.207542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58574 (local address 127.12.112.254:42711)
0807 22:47:51.207690 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:51.207695 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:51.207931 (+ 236us) server_negotiation.cc:407] Connection header received
0807 22:47:51.208093 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:51.208095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:51.208142 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:51.208231 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:47:51.208492 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:51.209050 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:51.210276 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:51.210568 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:51.210652 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:51.210996 (+ 344us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:47:51.638616 (+427620us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 22:47:51.638902 (+ 286us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58574: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 22:47:51.639142 18437 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58574: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 22:47:51.639320 18463 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:47:51.207468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42711 (local address 127.0.0.1:58574)
0807 22:47:51.207815 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:51.207832 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:51.207979 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:51.208253 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:51.208256 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:51.208265 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:47:51.208386 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:51.208393 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:51.209156 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:51.209159 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:51.210153 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:51.210163 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:51.210698 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:51.210701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:51.210789 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:51.210815 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:47:51.638883 (+428068us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 22:47:51.639108 (+ 225us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.112.254:42711: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":134,"threads_started":1}
I20260807 22:47:51.640029 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 18361
2026-08-07T22:47:51Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (697 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (127 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (127 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:51 dist-test-slave-tm1g krb5kdc[18475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:51 dist-test-slave-tm1g krb5kdc[18475](info): set up 2 sockets
Aug 07 22:47:51 dist-test-slave-tm1g krb5kdc[18475](info): commencing operation
krb5kdc: starting...
W20260807 22:47:52.970609 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:53 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:47:53.097837 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:39561
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:39561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:53.211691 18488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:53.212021 18488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:53.212096 18488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:53.216212 18488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:53.216301 18488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:53.216341 18488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:53.216378 18488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:53.216406 18488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:53.221935 18488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:39561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:39561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:53.223109 18488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:53.224169 18488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:53.232775 18493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:53.232785 18494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:53.232785 18496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:53.233062 18488 server_base.cc:1034] running on GCE node
I20260807 22:47:53.233740 18488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:53.234890 18488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:53.236079 18488 hybrid_clock.cc:648] HybridClock initialized: now 1786142873236062 us; error 31 us; skew 500 ppm
W20260807 22:47:54.071440 18488 net_util.cc:504] Time spent look up canonical hostname for localhost 'dist-test-slave-tm1g': real 0.835s user 0.001s sys 0.000s
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.073647 18488 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:47:54.074826 18488 webserver.cc:460] Webserver started at http://127.12.112.254:37363/ using document root <none> and password file <none>
I20260807 22:47:54.075439 18488 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:54.075534 18488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:54.075781 18488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:54.078052 18488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "99e01165ebcd4192b47a8167d1ae66f9"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "72ce1f2a83777070b0c5aead24eede5c"
server_key_iv: "e7ad2ffb1977a9c925fb6710565a8720"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.078728 18488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "99e01165ebcd4192b47a8167d1ae66f9"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "72ce1f2a83777070b0c5aead24eede5c"
server_key_iv: "e7ad2ffb1977a9c925fb6710565a8720"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.082511 18488 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:47:54.084908 18503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:54.086094 18488 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:54.086239 18488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "99e01165ebcd4192b47a8167d1ae66f9"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "72ce1f2a83777070b0c5aead24eede5c"
server_key_iv: "e7ad2ffb1977a9c925fb6710565a8720"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.086400 18488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:54.097425 18488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:54.100718 18488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:54.100919 18488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:54.108260 18488 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:39561
I20260807 22:47:54.108278 18560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:39561 every 8 connection(s)
I20260807 22:47:54.109244 18488 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:54.112133 18561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:54.118076 18561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9: Bootstrap starting.
I20260807 22:47:54.119428 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 18488
I20260807 22:47:54.119565 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:54.119989 12739 external_mini_cluster.cc:1428] Setting key 58e43500a95d5a5a9aef84870ec4f476
I20260807 22:47:54.121173 18561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:54.121948 18561 log.cc:824] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:54.123919 18561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9: No bootstrap required, opened a new log
I20260807 22:47:54.127418 18561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e01165ebcd4192b47a8167d1ae66f9" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39561 } }
I20260807 22:47:54.127660 18561 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:54.127738 18561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e01165ebcd4192b47a8167d1ae66f9, State: Initialized, Role: FOLLOWER
I20260807 22:47:54.128165 18561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e01165ebcd4192b47a8167d1ae66f9" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39561 } }
I20260807 22:47:54.128312 18561 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:54.128405 18561 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:54.128522 18561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:54.129781 18561 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e01165ebcd4192b47a8167d1ae66f9" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39561 } }
I20260807 22:47:54.130138 18561 leader_election.cc:302] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99e01165ebcd4192b47a8167d1ae66f9; no voters:
I20260807 22:47:54.130479 18561 leader_election.cc:288] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:54.130861 18568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:54.131091 18568 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [term 1 LEADER]: Becoming Leader. State: Replica: 99e01165ebcd4192b47a8167d1ae66f9, State: Running, Role: LEADER
I20260807 22:47:54.131407 18568 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e01165ebcd4192b47a8167d1ae66f9" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39561 } }
I20260807 22:47:54.131809 18561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:54.133396 18567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99e01165ebcd4192b47a8167d1ae66f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e01165ebcd4192b47a8167d1ae66f9" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39561 } } }
I20260807 22:47:54.133517 18567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:54.134693 18569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99e01165ebcd4192b47a8167d1ae66f9. Latest consensus state: current_term: 1 leader_uuid: "99e01165ebcd4192b47a8167d1ae66f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e01165ebcd4192b47a8167d1ae66f9" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39561 } } }
I20260807 22:47:54.134804 18569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:54.136235 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:54.121282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34306 (local address 127.12.112.254:39561)
0807 22:47:54.121770 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:54.121788 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:54.121822 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:47:54.122751 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:54.122776 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:54.123100 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:54.123453 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:54.124336 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.125336 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.126216 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.126751 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.126927 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:54.130054 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:54.130059 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:54.130072 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:54.130099 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:54.132364 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.132893 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.132908 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.132914 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.133084 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.133422 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.133427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.133430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.134014 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:54.134211 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:54.135015 (+ 804us) server_negotiation.cc:299] Negotiation successful
0807 22:47:54.135322 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":155,"threads_started":1}
W20260807 22:47:54.137219 18582 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:47:54.137296 18582 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:47:54.137357 18580 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:54.138062 18580 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:54.143889 18580 catalog_manager.cc:1347] Generated new cluster ID: 05cb08ce46304516a810a4b8b18d7508
I20260807 22:47:54.143981 18580 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:54.152879 18580 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:54.153780 18580 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:54.160647 18580 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99e01165ebcd4192b47a8167d1ae66f9: Generated new TSK 0
I20260807 22:47:54.161336 18580 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:47:54.191835 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39561
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:54.304354 18588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:54.304646 18588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:54.304719 18588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:54.308923 18588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:54.309006 18588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:54.309095 18588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:54.314261 18588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:54.315393 18588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:54.316475 18588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:54.326272 18594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:54.326382 18588 server_base.cc:1034] running on GCE node
W20260807 22:47:54.326350 18593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:54.326290 18596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:54.326941 18588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:54.327569 18588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:54.328755 18588 hybrid_clock.cc:648] HybridClock initialized: now 1786142874328732 us; error 36 us; skew 500 ppm
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.331506 18588 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:47:54.332432 18588 webserver.cc:460] Webserver started at http://127.12.112.193:43115/ using document root <none> and password file <none>
I20260807 22:47:54.333038 18588 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:54.333132 18588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:54.333374 18588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:54.335512 18588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "2f4c0b2f559f4962baaa939699456dec"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "c2e915a153eaca26e3f2babf7bc73629"
server_key_iv: "98d18aa894e18cef7d12c4d52b7dc30c"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.336076 18588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "2f4c0b2f559f4962baaa939699456dec"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "c2e915a153eaca26e3f2babf7bc73629"
server_key_iv: "98d18aa894e18cef7d12c4d52b7dc30c"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.339757 18588 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:47:54.342092 18603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:54.343277 18588 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:54.343431 18588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "2f4c0b2f559f4962baaa939699456dec"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "c2e915a153eaca26e3f2babf7bc73629"
server_key_iv: "98d18aa894e18cef7d12c4d52b7dc30c"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.343544 18588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:54.367846 18588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:54.370842 18588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:54.371052 18588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:54.371652 18588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:54.372476 18588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:54.372548 18588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:54.372617 18588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:54.372666 18588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:54.382030 18588 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:35763
I20260807 22:47:54.382061 18722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:35763 every 8 connection(s)
I20260807 22:47:54.382999 18588 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:54.388967 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 18588
I20260807 22:47:54.389103 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:54.389497 12739 external_mini_cluster.cc:1428] Setting key e8c33f8b79c0e00cc9d8909551ed1c03
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:54.397430 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:54.384751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:58877 (local address 127.12.112.254:39561)
0807 22:47:54.384909 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:54.384913 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:54.385705 (+ 792us) server_negotiation.cc:407] Connection header received
0807 22:47:54.387176 (+ 1471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:54.387180 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:54.387239 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:54.387345 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:54.388499 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.389101 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.390677 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.390925 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.391072 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:54.393582 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:54.393591 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:54.393594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:54.393616 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:54.395137 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.395806 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.395809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.395810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.395886 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.396285 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.396287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.396288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.396459 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:54.396532 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:54.397211 (+ 679us) server_negotiation.cc:299] Negotiation successful
0807 22:47:54.397310 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 22:47:54.398752 18725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:54.385110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39561 (local address 127.12.112.193:58877)
0807 22:47:54.385553 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:54.385595 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:54.386956 (+ 1361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:54.387515 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:54.387521 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:54.387874 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:54.388351 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:54.388364 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.389293 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.389297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:54.390537 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:54.390552 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.391111 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.391116 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:54.391299 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:54.391946 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:54.391963 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:54.393403 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:54.395265 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:54.395275 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:54.395293 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:54.395703 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:54.395989 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:54.395993 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:54.395995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:54.396181 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:54.396578 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:54.396587 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:54.396941 (+ 354us) client_negotiation.cc:769] Sending connection context
0807 22:47:54.397189 (+ 248us) client_negotiation.cc:240] Negotiation successful
0807 22:47:54.397591 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":120,"threads_started":1}
I20260807 22:47:54.400141 18723 heartbeater.cc:347] Connected to a master server at 127.12.112.254:39561
I20260807 22:47:54.400383 18723 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:47:54.400918 18723 heartbeater.cc:511] Master 127.12.112.254:39561 requested a full tablet report, sending...
I20260807 22:47:54.402516 18521 ts_manager.cc:194] Registered new tserver with Master: 2f4c0b2f559f4962baaa939699456dec (127.12.112.193:35763)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:47:54.403841 18521 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:58877
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:47:54.419003 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39561
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:54.532208 18728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:54.532486 18728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:54.532537 18728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:54.536707 18728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:54.536756 18728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:54.536813 18728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:54.541851 18728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:54.542774 18728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:54.543723 18728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:54.553251 18736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:54.553278 18733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:54.553288 18734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:54.553578 18728 server_base.cc:1034] running on GCE node
I20260807 22:47:54.553953 18728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:54.554726 18728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:54.555910 18728 hybrid_clock.cc:648] HybridClock initialized: now 1786142874555897 us; error 27 us; skew 500 ppm
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.558808 18728 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:47:54.559695 18728 webserver.cc:460] Webserver started at http://127.12.112.194:43433/ using document root <none> and password file <none>
I20260807 22:47:54.560273 18728 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:54.560364 18728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:54.560581 18728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:54.562835 18728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "379544eb5dd84564abe99002c4800a70"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "e1e78327b02f927fc9aca92857d73bdc"
server_key_iv: "21039f3acf5f4482f6b29dbb612cffab"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.563427 18728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "379544eb5dd84564abe99002c4800a70"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "e1e78327b02f927fc9aca92857d73bdc"
server_key_iv: "21039f3acf5f4482f6b29dbb612cffab"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.567227 18728 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:47:54.569507 18743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:54.570693 18728 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:47:54.570824 18728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "379544eb5dd84564abe99002c4800a70"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "e1e78327b02f927fc9aca92857d73bdc"
server_key_iv: "21039f3acf5f4482f6b29dbb612cffab"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.570932 18728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:54.583432 18728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:54.586756 18728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:54.586951 18728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:54.587517 18728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:54.588315 18728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:54.588387 18728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:54.588455 18728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:54.588510 18728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:54.597841 18728 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:43843
I20260807 22:47:54.597875 18864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:43843 every 8 connection(s)
I20260807 22:47:54.598758 18728 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:54.605532 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 18728
I20260807 22:47:54.605695 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:54.606002 12739 external_mini_cluster.cc:1428] Setting key cbcda90d9a05b855e38683027dfd11f6
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:54.613039 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:54.600657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:49523 (local address 127.12.112.254:39561)
0807 22:47:54.600845 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:54.600851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:54.601712 (+ 861us) server_negotiation.cc:407] Connection header received
0807 22:47:54.603198 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:54.603202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:54.603280 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:54.603363 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:54.604491 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.605077 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.606390 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.606648 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.606760 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:54.609422 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:54.609426 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:54.609428 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:54.609450 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:54.610944 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.611467 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.611471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.611473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.611556 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.611921 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.611926 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.611928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.612157 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:54.612257 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:54.612731 (+ 474us) server_negotiation.cc:299] Negotiation successful
0807 22:47:54.612863 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 22:47:54.613782 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:54.601083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39561 (local address 127.12.112.194:49523)
0807 22:47:54.601552 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:54.601593 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:54.602955 (+ 1362us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:54.603528 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:54.603534 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:54.603866 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:54.604328 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:54.604340 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.605189 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.605191 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:54.606228 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:54.606238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.606868 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.606873 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:54.607064 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:54.607690 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:54.607709 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:54.609241 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:54.611068 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:54.611074 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:54.611087 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:54.611354 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:54.611657 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:54.611660 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:54.611662 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:54.611815 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:54.612254 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:54.612259 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:54.612501 (+ 242us) client_negotiation.cc:769] Sending connection context
0807 22:47:54.612687 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 22:47:54.612993 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":140,"threads_started":1}
I20260807 22:47:54.614929 18865 heartbeater.cc:347] Connected to a master server at 127.12.112.254:39561
I20260807 22:47:54.615172 18865 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:54.615671 18865 heartbeater.cc:511] Master 127.12.112.254:39561 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:47:54.616724 18521 ts_manager.cc:194] Registered new tserver with Master: 379544eb5dd84564abe99002c4800a70 (127.12.112.194:43843)
I20260807 22:47:54.617360 18521 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:49523
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:47:54.633836 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39561
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:54.743713 18870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:54.744002 18870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:54.744077 18870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:54.748268 18870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:54.748347 18870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:54.748447 18870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:54.753688 18870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:39561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:54.754802 18870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:54.755836 18870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:54.765576 18875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:54.765583 18878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:54.765625 18876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:54.765923 18870 server_base.cc:1034] running on GCE node
I20260807 22:47:54.766274 18870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:54.766957 18870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:54.768121 18870 hybrid_clock.cc:648] HybridClock initialized: now 1786142874768107 us; error 23 us; skew 500 ppm
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.770931 18870 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:47:54.771865 18870 webserver.cc:460] Webserver started at http://127.12.112.195:33139/ using document root <none> and password file <none>
I20260807 22:47:54.772455 18870 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:54.772521 18870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:54.772761 18870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:54.775115 18870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "b047d7c0278e460b934ce134cc04a15f"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "197af18a6f683249c9facd76474b9647"
server_key_iv: "8532723256ac3f65ab30c9d49c177c05"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.775738 18870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "b047d7c0278e460b934ce134cc04a15f"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "197af18a6f683249c9facd76474b9647"
server_key_iv: "8532723256ac3f65ab30c9d49c177c05"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.779651 18870 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:47:54.782081 18885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:54.783432 18870 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:54.783567 18870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "b047d7c0278e460b934ce134cc04a15f"
format_stamp: "Formatted at 2026-08-07 22:47:54 on dist-test-slave-tm1g"
server_key: "197af18a6f683249c9facd76474b9647"
server_key_iv: "8532723256ac3f65ab30c9d49c177c05"
server_key_version: "encryptionkey@0"
I20260807 22:47:54.783681 18870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:54.808657 18870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:54.812446 18870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:54.812666 18870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:54.813292 18870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:54.814157 18870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:54.814204 18870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:54.814276 18870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:54.814332 18870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:54.823608 18870 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:45783
I20260807 22:47:54.823645 19003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:45783 every 8 connection(s)
I20260807 22:47:54.824539 18870 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:47:54.830528 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 18870
I20260807 22:47:54.830622 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:47:54.830919 12739 external_mini_cluster.cc:1428] Setting key 3350dba045421863e3d0e75c6d61bc6d
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:47:54.838621 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:54.826460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:51921 (local address 127.12.112.254:39561)
0807 22:47:54.826616 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:54.826620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:54.827448 (+ 828us) server_negotiation.cc:407] Connection header received
0807 22:47:54.828849 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:54.828853 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:54.828913 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:54.829018 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:54.830165 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.830908 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.832542 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.832758 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.832905 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:54.835548 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:54.835551 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:54.835553 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:54.835576 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:54.836813 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.837273 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.837275 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.837277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.837355 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.837657 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.837660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.837661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.837836 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:54.837911 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:54.838410 (+ 499us) server_negotiation.cc:299] Negotiation successful
0807 22:47:54.838503 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:47:54.839421 19006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:54.826833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39561 (local address 127.12.112.195:51921)
0807 22:47:54.827271 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:54.827339 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:54.828623 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:54.829192 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:54.829199 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:54.829553 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:54.830016 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:54.830029 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.831074 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.831077 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:54.832430 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:54.832441 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.832955 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.832960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:54.833148 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:54.833785 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:54.833801 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:54.835391 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:54.836920 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:54.836924 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:54.836935 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:54.837189 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:54.837436 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:54.837438 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:54.837439 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:54.837577 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:54.837924 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:54.837929 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:54.838155 (+ 226us) client_negotiation.cc:769] Sending connection context
0807 22:47:54.838360 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 22:47:54.838616 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":110,"threads_started":1}
I20260807 22:47:54.840502 19004 heartbeater.cc:347] Connected to a master server at 127.12.112.254:39561
I20260807 22:47:54.840708 19004 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:54.841138 19004 heartbeater.cc:511] Master 127.12.112.254:39561 requested a full tablet report, sending...
I20260807 22:47:54.842124 18521 ts_manager.cc:194] Registered new tserver with Master: b047d7c0278e460b934ce134cc04a15f (127.12.112.195:45783)
I20260807 22:47:54.842720 18521 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:51921
I20260807 22:47:54.844880 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/test-admin.keytab.
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.862188 12739 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 22:47:54.865235 19012 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:47:54.863659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56744 (local address 127.12.112.193:35763)
0807 22:47:54.863988 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:54.864015 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:54.864040 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:47:54.864093 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:54.864097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:54.864314 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:54.864454 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:54.865005 (+ 551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56744: BlockingRecv error: recv got EOF from 127.0.0.1:56744 (error 108)
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":87,"threads_started":1}
W20260807 22:47:54.865348 12739 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5cc' of type FILE
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.866531 12739 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.867549 12739 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:47:54.877341 19012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:54.868425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56750 (local address 127.12.112.193:35763)
0807 22:47:54.868555 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:54.868560 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:54.868671 (+ 111us) server_negotiation.cc:407] Connection header received
0807 22:47:54.868828 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:54.868835 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:54.868872 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:54.868958 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:54.869481 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.870255 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.871139 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.871495 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.871619 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:54.873835 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:54.873844 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:54.873855 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:54.873919 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:54.875571 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.876022 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.876027 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.876028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.876106 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.876389 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.876393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.876394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.876632 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:54.876841 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:54.877057 (+ 216us) server_negotiation.cc:299] Negotiation successful
0807 22:47:54.877217 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 22:47:54.881141 19012 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:47:54.880122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56752 (local address 127.12.112.193:35763)
0807 22:47:54.880246 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:54.880251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:54.880360 (+ 109us) server_negotiation.cc:407] Connection header received
0807 22:47:54.880501 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:54.880505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:54.880549 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:54.880632 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:54.881034 (+ 402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56752: BlockingRecv error: recv got EOF from 127.0.0.1:56752 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 22:47:54.881311 12739 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5cc' of type FILE
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.882279 12739 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.883279 12739 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:47:54.891553 19012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:54.884084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56756 (local address 127.12.112.193:35763)
0807 22:47:54.884191 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:54.884195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:54.884335 (+ 140us) server_negotiation.cc:407] Connection header received
0807 22:47:54.884427 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:54.884429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:54.884460 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:54.884518 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:54.884957 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.885447 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.886164 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.886441 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.886523 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:54.888602 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:54.888608 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:54.888612 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:54.888638 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:54.890047 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.890504 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.890507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.890508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.890586 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.890837 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.890838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.890839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.890974 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:54.891070 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:54.891260 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 22:47:54.891349 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260807 22:47:54.894039 19012 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:47:54.893074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.12.112.193:35763)
0807 22:47:54.893193 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:54.893196 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:54.893303 (+ 107us) server_negotiation.cc:407] Connection header received
0807 22:47:54.893404 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:54.893407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:54.893462 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:54.893548 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:54.893924 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56768: BlockingRecv error: recv got EOF from 127.0.0.1:56768 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 22:47:54.894198 12739 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142843719124-12739-0/krb5kdc/krb5cc' of type FILE
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.895169 12739 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:54.896018 12739 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:47:54.903970 19012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:54.896869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56778 (local address 127.12.112.193:35763)
0807 22:47:54.896976 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:54.896979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:54.896991 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:47:54.897082 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:54.897084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:54.897114 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:54.897177 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:54.897615 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.898069 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.898862 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:54.899070 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:54.899145 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:54.901117 (+ 1972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:54.901120 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:54.901122 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:54.901142 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:54.902562 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.902910 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.902912 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.902913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.902982 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:54.903205 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:54.903207 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:54.903208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:54.903348 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:54.903438 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:54.903691 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 22:47:54.903810 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:47:54.904981 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 18588
I20260807 22:47:54.912313 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 18728
I20260807 22:47:54.919302 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 18870
I20260807 22:47:54.925446 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 18488
2026-08-07T22:47:54Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3031 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[19026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[19026](info): set up 2 sockets
Aug 07 22:47:54 dist-test-slave-tm1g krb5kdc[19026](info): commencing operation
krb5kdc: starting...
W20260807 22:47:55.994289 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:47:56 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:47:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:47:56Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.254.keytab.
Entry for principal oryx/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.254.keytab.
I20260807 22:47:56.118822 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:37679
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.254.keytab
--principal=oryx/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:37679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:56.228855 19039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:56.229133 19039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:56.229213 19039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:56.233204 19039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:56.233281 19039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:56.233319 19039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:56.233374 19039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:56.233410 19039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:56.238611 19039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:37679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.254.keytab
--principal=oryx/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:37679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:56.239615 19039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:56.240607 19039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:56.249058 19048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:56.249095 19045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:56.249120 19039 server_base.cc:1034] running on GCE node
W20260807 22:47:56.249204 19046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:56.249809 19039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:56.250907 19039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:56.252100 19039 hybrid_clock.cc:648] HybridClock initialized: now 1786142876252081 us; error 32 us; skew 500 ppm
Aug 07 22:47:56 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:56.254981 19039 init.cc:377] Logged in from keytab as oryx/127.12.112.254@KRBTEST.COM (short username oryx)
I20260807 22:47:56.255841 19039 webserver.cc:460] Webserver started at http://127.12.112.254:42943/ using document root <none> and password file <none>
I20260807 22:47:56.256362 19039 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:56.256420 19039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:56.256575 19039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:56.258682 19039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "5c5a75799fc34b0a9948786dd415013f"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "2d885d6dfa1af4fec6dcf55217626e77"
server_key_iv: "1dbfd13b64997ac1dfbbaac1a8f96418"
server_key_version: "encryptionkey@0"
I20260807 22:47:56.259186 19039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "5c5a75799fc34b0a9948786dd415013f"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "2d885d6dfa1af4fec6dcf55217626e77"
server_key_iv: "1dbfd13b64997ac1dfbbaac1a8f96418"
server_key_version: "encryptionkey@0"
I20260807 22:47:56.262796 19039 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:47:56.265003 19056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:56.266177 19039 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:56.266371 19039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "5c5a75799fc34b0a9948786dd415013f"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "2d885d6dfa1af4fec6dcf55217626e77"
server_key_iv: "1dbfd13b64997ac1dfbbaac1a8f96418"
server_key_version: "encryptionkey@0"
I20260807 22:47:56.266485 19039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:56.290808 19039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:56.293546 19039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:56.293751 19039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:56.300642 19039 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:37679
I20260807 22:47:56.300935 19109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:37679 every 8 connection(s)
I20260807 22:47:56.301611 19039 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:47:56.304311 19110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:56.304993 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 19039
I20260807 22:47:56.305143 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:47:56.305469 12739 external_mini_cluster.cc:1428] Setting key 07a27747d030ded4ecf6df783d48445d
I20260807 22:47:56.311138 19110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f: Bootstrap starting.
I20260807 22:47:56.313937 19110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:56.314724 19110 log.cc:824] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:47:56 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:47:56.317099 19110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f: No bootstrap required, opened a new log
I20260807 22:47:56.321283 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:56.306946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53940 (local address 127.12.112.254:37679)
0807 22:47:56.307406 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:56.307425 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:56.307467 (+ 42us) server_negotiation.cc:407] Connection header received
0807 22:47:56.308284 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:56.308307 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:56.308724 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:56.309085 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:56.309782 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:56.311289 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:56.312300 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:56.313009 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:56.313168 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:56.316005 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:56.316011 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:56.316027 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:56.316056 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:56.318027 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:56.318564 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:56.318570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:56.318577 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:56.318720 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:56.319013 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:56.319018 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:56.319019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:56.319609 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:56.319803 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:56.320029 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 22:47:56.320320 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":110,"threads_started":1}
I20260807 22:47:56.321714 19110 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } }
I20260807 22:47:56.321981 19110 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:56.322108 19110 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c5a75799fc34b0a9948786dd415013f, State: Initialized, Role: FOLLOWER
I20260807 22:47:56.322563 19110 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } }
I20260807 22:47:56.322687 19110 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:47:56.322772 19110 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:47:56.322868 19110 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:56.323957 19110 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } }
I20260807 22:47:56.324304 19110 leader_election.cc:302] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c5a75799fc34b0a9948786dd415013f; no voters:
I20260807 22:47:56.324625 19110 leader_election.cc:288] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:47:56.324837 19115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:56.325109 19115 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 1 LEADER]: Becoming Leader. State: Replica: 5c5a75799fc34b0a9948786dd415013f, State: Running, Role: LEADER
I20260807 22:47:56.325507 19115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } }
I20260807 22:47:56.325990 19110 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:56.326644 19117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c5a75799fc34b0a9948786dd415013f. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } }
I20260807 22:47:56.326872 19117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:56.328006 19118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } }
I20260807 22:47:56.328172 19118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:56.328495 19124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:47:56.331607 19124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:47:56.337224 19124 catalog_manager.cc:1347] Generated new cluster ID: eca2e9fe0f4340ad8823ad9488ddf6a7
I20260807 22:47:56.337293 19124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:47:56.359079 19124 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:47:56.360088 19124 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:47:56.370095 19124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f: Generated new TSK 0
I20260807 22:47:56.370929 19124 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab.
Entry for principal oryx/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab.
I20260807 22:47:56.411708 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37679
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab
--principal=oryx/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:56.522729 19138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:56.522990 19138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:56.523061 19138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:56.527201 19138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:56.527284 19138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:56.527367 19138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:56.532606 19138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab
--principal=oryx/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:56.533602 19138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:56.534652 19138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:56.544057 19145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:56.544029 19144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:56.544200 19138 server_base.cc:1034] running on GCE node
W20260807 22:47:56.544236 19147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:56.544690 19138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:56.545329 19138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:56.546526 19138 hybrid_clock.cc:648] HybridClock initialized: now 1786142876546496 us; error 47 us; skew 500 ppm
Aug 07 22:47:56 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:56.549288 19138 init.cc:377] Logged in from keytab as oryx/127.12.112.193@KRBTEST.COM (short username oryx)
I20260807 22:47:56.550119 19138 webserver.cc:460] Webserver started at http://127.12.112.193:33895/ using document root <none> and password file <none>
I20260807 22:47:56.550727 19138 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:56.550820 19138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:56.551051 19138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:56.553025 19138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "5d7ff18bd59840aaac2fd2fed2d15683"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "43ee0a8ed504efb2aed1decbd304d2d9"
server_key_iv: "79b5fd1583385aadb7d3f2555d851306"
server_key_version: "encryptionkey@0"
I20260807 22:47:56.553597 19138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "5d7ff18bd59840aaac2fd2fed2d15683"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "43ee0a8ed504efb2aed1decbd304d2d9"
server_key_iv: "79b5fd1583385aadb7d3f2555d851306"
server_key_version: "encryptionkey@0"
I20260807 22:47:56.557186 19138 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:47:56.559602 19154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:56.560711 19138 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:47:56.560848 19138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "5d7ff18bd59840aaac2fd2fed2d15683"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "43ee0a8ed504efb2aed1decbd304d2d9"
server_key_iv: "79b5fd1583385aadb7d3f2555d851306"
server_key_version: "encryptionkey@0"
I20260807 22:47:56.560956 19138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:56.579650 19138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:56.582710 19138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:56.582911 19138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:56.583478 19138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:56.584281 19138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:56.584350 19138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:56.584419 19138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:56.584461 19138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:56.593581 19138 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:44951
I20260807 22:47:56.593606 19269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:44951 every 8 connection(s)
I20260807 22:47:56.594518 19138 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:56.598079 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 19138
I20260807 22:47:56.598222 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:47:56.598604 12739 external_mini_cluster.cc:1428] Setting key 69c420a4ff2ec59884fbf4e1f92ef8f3
Aug 07 22:47:56 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:47:56.609139 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:56.596251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:39373 (local address 127.12.112.254:37679)
0807 22:47:56.596417 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:56.596422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:56.597200 (+ 778us) server_negotiation.cc:407] Connection header received
0807 22:47:56.598634 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:56.598646 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:56.598718 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:56.598816 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:56.600309 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:56.601091 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:56.602276 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:56.602582 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:56.602698 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:56.605192 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:56.605199 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:56.605203 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:56.605235 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:56.607027 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:56.607510 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:56.607515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:56.607518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:56.607616 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:56.607940 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:56.607946 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:56.607948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:56.608209 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:56.608323 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:56.608786 (+ 463us) server_negotiation.cc:299] Negotiation successful
0807 22:47:56.608934 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
WARNING: no policy specified for oryx/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:47:56.609789 19272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:56.596625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.193:39373)
0807 22:47:56.597055 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:56.597095 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:56.598403 (+ 1308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:56.599017 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:56.599023 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:56.599513 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:56.600154 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:56.600175 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:56.601227 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:56.601229 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:56.602153 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:56.602162 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:56.602732 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:56.602736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:56.602916 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:56.603519 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:56.603535 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:56.605018 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:56.607140 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:56.607144 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:56.607155 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:56.607398 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:56.607715 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:56.607717 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:56.607718 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:56.607843 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:56.608315 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:56.608320 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:56.608537 (+ 217us) client_negotiation.cc:769] Sending connection context
0807 22:47:56.608685 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 22:47:56.608928 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":116,"threads_started":1}
I20260807 22:47:56.610965 19270 heartbeater.cc:347] Connected to a master server at 127.12.112.254:37679
I20260807 22:47:56.611189 19270 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:56.611711 19270 heartbeater.cc:511] Master 127.12.112.254:37679 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.194@KRBTEST.COM" created.
I20260807 22:47:56.613266 19074 ts_manager.cc:194] Registered new tserver with Master: 5d7ff18bd59840aaac2fd2fed2d15683 (127.12.112.193:44951)
I20260807 22:47:56.614935 19074 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:39373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab.
Entry for principal oryx/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab.
I20260807 22:47:56.629218 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37679
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab
--principal=oryx/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:56.741211 19275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:56.741441 19275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:56.741482 19275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:56.745579 19275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:56.745630 19275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:56.745733 19275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:56.750867 19275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab
--principal=oryx/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:56.751849 19275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:56.752837 19275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:56.762421 19284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:56.762367 19282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:56.762457 19281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:56.762660 19275 server_base.cc:1034] running on GCE node
I20260807 22:47:56.763067 19275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:56.763756 19275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:56.764935 19275 hybrid_clock.cc:648] HybridClock initialized: now 1786142876764912 us; error 32 us; skew 500 ppm
Aug 07 22:47:56 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:56.767679 19275 init.cc:377] Logged in from keytab as oryx/127.12.112.194@KRBTEST.COM (short username oryx)
I20260807 22:47:56.768493 19275 webserver.cc:460] Webserver started at http://127.12.112.194:39551/ using document root <none> and password file <none>
I20260807 22:47:56.769093 19275 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:56.769181 19275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:56.769416 19275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:56.771690 19275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "aac3f5763d42421f9c82fc39a01d991a"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "232a966e559a710ea448f31ac7f0700f"
server_key_iv: "836d828457ec2f00278c0cd02fcc3cf8"
server_key_version: "encryptionkey@0"
I20260807 22:47:56.772243 19275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "aac3f5763d42421f9c82fc39a01d991a"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "232a966e559a710ea448f31ac7f0700f"
server_key_iv: "836d828457ec2f00278c0cd02fcc3cf8"
server_key_version: "encryptionkey@0"
I20260807 22:47:56.775877 19275 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 22:47:56.778192 19291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:56.779488 19275 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:47:56.779593 19275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "aac3f5763d42421f9c82fc39a01d991a"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "232a966e559a710ea448f31ac7f0700f"
server_key_iv: "836d828457ec2f00278c0cd02fcc3cf8"
server_key_version: "encryptionkey@0"
I20260807 22:47:56.779675 19275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:56.803321 19275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:56.806452 19275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:56.806617 19275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:56.807153 19275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:56.807934 19275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:56.807989 19275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:56.808035 19275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:56.808050 19275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:56.817042 19275 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:44085
I20260807 22:47:56.817091 19405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:44085 every 8 connection(s)
I20260807 22:47:56.817930 19275 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:56.825722 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 19275
I20260807 22:47:56.825848 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:47:56.826200 12739 external_mini_cluster.cc:1428] Setting key 0900bc447fb05b248e62d930edda5a25
Aug 07 22:47:56 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:47:56.832149 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:56.819838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:43993 (local address 127.12.112.254:37679)
0807 22:47:56.819974 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:56.819978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:56.820919 (+ 941us) server_negotiation.cc:407] Connection header received
0807 22:47:56.822215 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:56.822218 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:56.822264 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:56.822388 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:56.823496 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:56.824023 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:56.825093 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:56.825326 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:56.825404 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:56.828401 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:56.828405 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:56.828407 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:56.828443 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:56.829904 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:56.830434 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:56.830439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:56.830442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:56.830540 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:56.830865 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:56.830870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:56.830874 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:56.831137 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:56.831259 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:56.831737 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 22:47:56.831878 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:47:56.832896 19408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:56.820221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.194:43993)
0807 22:47:56.820758 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:56.820802 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:56.822023 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:56.822540 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:56.822546 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:56.822895 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:56.823369 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:56.823381 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:56.824129 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:56.824131 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:56.824981 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:56.824990 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:56.825506 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:56.825514 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:56.825722 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:56.826429 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:56.826452 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:56.828208 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:56.830036 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:56.830040 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:56.830050 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:56.830294 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:56.830636 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:56.830638 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:56.830639 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:56.830771 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:56.831255 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:56.831260 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:56.831483 (+ 223us) client_negotiation.cc:769] Sending connection context
0807 22:47:56.831645 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 22:47:56.831887 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":185,"threads_started":1}
I20260807 22:47:56.834110 19406 heartbeater.cc:347] Connected to a master server at 127.12.112.254:37679
I20260807 22:47:56.834398 19406 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:56.835012 19406 heartbeater.cc:511] Master 127.12.112.254:37679 requested a full tablet report, sending...
I20260807 22:47:56.836130 19074 ts_manager.cc:194] Registered new tserver with Master: aac3f5763d42421f9c82fc39a01d991a (127.12.112.194:44085)
I20260807 22:47:56.836701 19074 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:43993
WARNING: no policy specified for oryx/127.12.112.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab.
Entry for principal oryx/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab.
I20260807 22:47:56.855473 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37679
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab
--principal=oryx/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:56.968003 19411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:56.968286 19411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:56.968357 19411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:56.972450 19411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:56.972527 19411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:56.972615 19411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:56.977663 19411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab
--principal=oryx/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:37679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:56.978680 19411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:56.979668 19411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:56.989075 19417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:56.989073 19418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:56.989187 19411 server_base.cc:1034] running on GCE node
W20260807 22:47:56.989075 19421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:56.989765 19411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:56.990437 19411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:56.991600 19411 hybrid_clock.cc:648] HybridClock initialized: now 1786142876991581 us; error 29 us; skew 500 ppm
Aug 07 22:47:56 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:56.996912 19411 init.cc:377] Logged in from keytab as oryx/127.12.112.195@KRBTEST.COM (short username oryx)
I20260807 22:47:56.997817 19411 webserver.cc:460] Webserver started at http://127.12.112.195:35903/ using document root <none> and password file <none>
I20260807 22:47:56.998433 19411 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:56.998498 19411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:56.998729 19411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:57.000730 19411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "fdd31fe8f1934b1e88d94741df87b368"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "6d5e036cab98141dbb0cc0990b5be5ae"
server_key_iv: "29e21d78d82d63b244d95544b7362405"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.001286 19411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "fdd31fe8f1934b1e88d94741df87b368"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "6d5e036cab98141dbb0cc0990b5be5ae"
server_key_iv: "29e21d78d82d63b244d95544b7362405"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.004927 19411 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:47:57.007336 19429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.008541 19411 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:57.008679 19411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "fdd31fe8f1934b1e88d94741df87b368"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "6d5e036cab98141dbb0cc0990b5be5ae"
server_key_iv: "29e21d78d82d63b244d95544b7362405"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.008787 19411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:57.022393 19411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:57.025015 19411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:57.025214 19411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:57.025782 19411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:57.026721 19411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:57.026790 19411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.026860 19411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:57.026895 19411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.035686 19411 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:44531
I20260807 22:47:57.035723 19548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:44531 every 8 connection(s)
I20260807 22:47:57.036537 19411 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:47:57.041985 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 19411
I20260807 22:47:57.042137 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:47:57.042488 12739 external_mini_cluster.cc:1428] Setting key 4774294681b23e379126eab32171cf84
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:47:57.050678 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.038253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:50085 (local address 127.12.112.254:37679)
0807 22:47:57.038430 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.038434 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.039347 (+ 913us) server_negotiation.cc:407] Connection header received
0807 22:47:57.040806 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.040809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.040857 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.040931 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.042039 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.042857 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.044472 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.044803 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.044885 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.047301 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.047304 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.047306 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.047330 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.048866 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.049351 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.049353 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.049355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.049439 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.049730 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.049732 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.049733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.049904 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.049979 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.050466 (+ 487us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.050561 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 22:47:57.051522 19551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.038626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.195:50085)
0807 22:47:57.039156 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.039214 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.040615 (+ 1401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.041090 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.041096 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.041434 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.041886 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.041899 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.042990 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.042995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.044332 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.044343 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.044949 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.044952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.045089 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.045636 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.045652 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.047153 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.048983 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.048988 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.049009 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.049262 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.049521 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.049523 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.049524 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.049650 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.049991 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.050003 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.050217 (+ 214us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.050427 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.050679 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":131,"threads_started":1}
I20260807 22:47:57.052596 19549 heartbeater.cc:347] Connected to a master server at 127.12.112.254:37679
I20260807 22:47:57.052834 19549 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:57.053321 19549 heartbeater.cc:511] Master 127.12.112.254:37679 requested a full tablet report, sending...
I20260807 22:47:57.054412 19074 ts_manager.cc:194] Registered new tserver with Master: fdd31fe8f1934b1e88d94741df87b368 (127.12.112.195:44531)
I20260807 22:47:57.054984 19074 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:50085
I20260807 22:47:57.056455 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.112.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.253.keytab.
Entry for principal oryx/127.12.112.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.253.keytab.
I20260807 22:47:57.089160 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.253:46051
--webserver_interface=127.12.112.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.253.keytab
--principal=oryx/127.12.112.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:37679,127.12.112.253:46051
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:47:57.216066 19554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:57.216305 19554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:57.216344 19554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:57.220285 19554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:57.220336 19554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:57.220355 19554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:57.220372 19554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:57.220387 19554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:57.225584 19554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:37679,127.12.112.253:46051
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.253.keytab
--principal=oryx/127.12.112.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.253:46051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.112.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
W20260807 22:47:57.225780 19554 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.112.254:37679,127.12.112.253:46051'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 22:47:57.226682 19554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:57.227761 19554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:57.236073 19561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:57.236086 19560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:57.236202 19554 server_base.cc:1034] running on GCE node
W20260807 22:47:57.236366 19564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:57.236917 19554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:57.237936 19554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:57.239121 19554 hybrid_clock.cc:648] HybridClock initialized: now 1786142877239102 us; error 30 us; skew 500 ppm
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:57.241796 19554 init.cc:377] Logged in from keytab as oryx/127.12.112.253@KRBTEST.COM (short username oryx)
I20260807 22:47:57.242695 19554 webserver.cc:460] Webserver started at http://127.12.112.253:34285/ using document root <none> and password file <none>
I20260807 22:47:57.243234 19554 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:57.243322 19554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:57.243564 19554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:57.245565 19554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data/instance:
uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34"
format_stamp: "Formatted at 2026-08-07 22:47:57 on dist-test-slave-tm1g"
server_key: "fd784da9401c29049fb8c2a7eeed70f6"
server_key_iv: "dfbaf422fa0344a0302ba08376940a47"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.246140 19554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal/instance:
uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34"
format_stamp: "Formatted at 2026-08-07 22:47:57 on dist-test-slave-tm1g"
server_key: "fd784da9401c29049fb8c2a7eeed70f6"
server_key_iv: "dfbaf422fa0344a0302ba08376940a47"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.249861 19554 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:47:57.252226 19572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.253376 19554 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:47:57.253521 19554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal
uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34"
format_stamp: "Formatted at 2026-08-07 22:47:57 on dist-test-slave-tm1g"
server_key: "fd784da9401c29049fb8c2a7eeed70f6"
server_key_iv: "dfbaf422fa0344a0302ba08376940a47"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.253631 19554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:57.266646 19554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:57.269762 19554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:57.269968 19554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:57.276566 19554 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.253:46051
I20260807 22:47:57.276842 19625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.253:46051 every 8 connection(s)
I20260807 22:47:57.277520 19554 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
I20260807 22:47:57.280187 19626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:57.283895 19626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:47:57.285660 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 19554
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.253@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.112.253@KRBTEST.COM
I20260807 22:47:57.297845 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.285696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53946 (local address 127.12.112.254:37679)
0807 22:47:57.285869 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.285875 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.287098 (+ 1223us) server_negotiation.cc:407] Connection header received
0807 22:47:57.288035 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.288037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.288083 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.288149 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.289098 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.289624 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.290920 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.291187 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.291264 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.293839 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.293843 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.293845 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.293868 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.295648 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.296155 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.296158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.296160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.296250 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.296644 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.296648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.296650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.296896 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.296974 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.297533 (+ 559us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.297680 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 22:47:57.298741 19630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.286572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53666 (local address 127.12.112.253:46051)
0807 22:47:57.286973 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.286991 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.287034 (+ 43us) server_negotiation.cc:407] Connection header received
0807 22:47:57.287817 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.287840 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.288077 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.288261 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.288966 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.289981 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.291016 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.291468 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.291568 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.294353 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.294364 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.294376 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.294406 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.296195 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.296716 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.296721 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.296722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.296790 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.297119 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.297121 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.297122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.297336 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.297536 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.297748 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.297881 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":138,"threads_started":1}
I20260807 22:47:57.298739 19628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.286054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:53946)
0807 22:47:57.286935 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.286988 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.287817 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.288224 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.288229 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.288678 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.288946 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.288964 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.289749 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.289753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.290786 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.290796 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.291330 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.291334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.291527 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.292106 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.292121 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.293668 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.295753 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.295761 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.295767 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.296054 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.296345 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.296347 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.296349 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.296537 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.297000 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.297007 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.297274 (+ 267us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.297472 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.297788 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":98,"threads_started":1}
I20260807 22:47:57.300056 19626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.253@KRBTEST.COM for oryx/127.12.112.253@KRBTEST.COM
I20260807 22:47:57.308601 19628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.300571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:46051 (local address 127.0.0.1:53680)
0807 22:47:57.300733 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.300749 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.300825 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.301090 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.301093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.301252 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.301358 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.301364 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.302039 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.302043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.302897 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.302907 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.303858 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.303861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.303960 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.304363 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.304375 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.305607 (+ 1232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.307217 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.307223 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.307225 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.307414 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.307681 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.307684 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.307686 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.307764 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.308104 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.308107 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.308183 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.308292 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.308432 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260807 22:47:57.308611 19630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.300647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53680 (local address 127.12.112.253:46051)
0807 22:47:57.300929 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.300931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.300938 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:47:57.300958 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.300959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.300983 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.301032 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.301466 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.301934 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.303012 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.303747 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.303832 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.305747 (+ 1915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.305750 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.305752 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.305770 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.307110 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.307509 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.307514 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.307516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.307586 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.307849 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.307854 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.307856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.308013 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.308114 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.308345 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.308486 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":226}
I20260807 22:47:57.311471 19626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: Bootstrap starting.
I20260807 22:47:57.313982 19626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:57.314785 19626 log.cc:824] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:57.316599 19626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: No bootstrap required, opened a new log
I20260807 22:47:57.319650 19626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } }
I20260807 22:47:57.319864 19626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:57.319945 19626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d29d3d95ddd4e0db7bb585a5b14bb34, State: Initialized, Role: FOLLOWER
I20260807 22:47:57.320356 19626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } }
I20260807 22:47:57.320837 19632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } } }
I20260807 22:47:57.320947 19632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:47:57.321516 19626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 22:47:57.326318 19643 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:47:57.326404 19643 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:47:57.329118 19554 master_runner.cc:428] Detected that this master 4d29d3d95ddd4e0db7bb585a5b14bb34 is joining an existing cluster
I20260807 22:47:57.329169 19554 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.112.253:46051
I20260807 22:47:57.339865 19630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.331309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53686 (local address 127.12.112.253:46051)
0807 22:47:57.331412 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.331416 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.331782 (+ 366us) server_negotiation.cc:407] Connection header received
0807 22:47:57.331957 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.331960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.332023 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.332088 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.333075 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.333677 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.334549 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.334883 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.335000 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.336419 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.336423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.336426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.336452 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.338204 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.338654 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.338659 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.338661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.338740 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.339037 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.339042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.339044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.339252 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.339343 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.339586 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.339731 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":33}
I20260807 22:47:57.339879 19650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.331429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:46051 (local address 127.0.0.1:53686)
0807 22:47:57.331700 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.331714 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.331820 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.332591 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.332596 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.332811 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.332950 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.332958 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.333797 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.333803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.334437 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.334447 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.335008 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.335014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.335115 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.335714 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.335744 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.336270 (+ 526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.338349 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.338352 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.338354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.338555 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.338853 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.338857 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.338859 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.338944 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.339328 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.339331 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.339423 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.339541 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.339681 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"spinlock_wait_cycles":896,"thread_start_us":87,"threads_started":1}
I20260807 22:47:57.340404 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.331309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53952 (local address 127.12.112.254:37679)
0807 22:47:57.331438 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.331444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.331731 (+ 287us) server_negotiation.cc:407] Connection header received
0807 22:47:57.331866 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.331869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.331947 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.332040 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.332577 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.333189 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.334418 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.334699 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.334816 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.336835 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.336839 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.336842 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.336899 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.338577 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.339104 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.339107 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.339109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.339187 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.339506 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.339509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.339511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.339716 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.339786 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.340140 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.340253 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:47:57.341331 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.331226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:53952)
0807 22:47:57.331622 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.331639 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.331774 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.332061 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.332064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.332317 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.332456 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.332464 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.333305 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.333308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.334261 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.334272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.334840 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.334843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.334980 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.336302 (+ 1322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.336321 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.336686 (+ 365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.338701 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.338704 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.338706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.338978 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.339290 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.339293 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.339295 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.339390 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.339862 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.339865 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.339961 (+ 96us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.341012 (+ 1051us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.341147 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":38,"spinlock_wait_cycles":1792,"thread_start_us":209,"threads_started":1}
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.254@KRBTEST.COM for oryx/127.12.112.253@KRBTEST.COM
I20260807 22:47:57.355353 19630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.345732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53698 (local address 127.12.112.253:46051)
0807 22:47:57.345838 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.345842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.346634 (+ 792us) server_negotiation.cc:407] Connection header received
0807 22:47:57.346817 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.346820 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.346860 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.346921 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.347679 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.348143 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.349345 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.349560 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.349639 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.351910 (+ 2271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.351914 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.351916 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.351936 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.353478 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.354030 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.354035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.354037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.354121 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.354465 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.354468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.354470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.354638 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.354749 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.355092 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.355199 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:47:57.355362 19651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.345661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:46051 (local address 127.0.0.1:53698)
0807 22:47:57.346504 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.346559 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.346687 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.346978 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.346984 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.347402 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.347528 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.347535 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.348245 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.348249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.349232 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.349243 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.349668 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.349672 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.349781 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.350239 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.350254 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.351764 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.353588 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.353599 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.353605 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.353922 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.354219 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.354223 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.354225 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.354368 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.354750 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.354757 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.354881 (+ 124us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.355014 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.355202 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":99,"threads_started":1}
I20260807 22:47:57.357466 19073 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.112.253:46051: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34"
member_type: NON_VOTER
last_known_addr {
host: "127.12.112.253"
port: 46051
}
attrs {
promote: true
}
}
dest_uuid: "5c5a75799fc34b0a9948786dd415013f"
cas_config_opid_index: -1
I20260807 22:47:57.358150 19073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } }
I20260807 22:47:57.359875 19654 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 4d29d3d95ddd4e0db7bb585a5b14bb34 (127.12.112.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } } }
I20260807 22:47:57.360584 19599 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:57.361420 19654 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.112.253:46051
I20260807 22:47:57.361698 19654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } } }
I20260807 22:47:57.361832 19654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:57.361945 19599 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Refusing update from remote peer 5c5a75799fc34b0a9948786dd415013f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 22:47:57.362002 19554 master.cc:537] Master@127.12.112.253:46051 shutting down...
I20260807 22:47:57.362774 19653 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 22:47:57.364933 19060 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260807 22:47:57.366055 19060 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f -> Peer 4d29d3d95ddd4e0db7bb585a5b14bb34 (127.12.112.253:46051): Couldn't send request to peer 4d29d3d95ddd4e0db7bb585a5b14bb34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 22:47:57.366755 19554 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:57.367034 19554 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:57.367201 19554 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: stopping tablet replica
I20260807 22:47:57.371865 19554 master.cc:552] Master@127.12.112.253:46051 shutdown complete.
I20260807 22:47:57.371969 19554 master_runner.cc:305] Clearing existing system tablet
I20260807 22:47:57.372296 19554 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:57.372404 19554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
WARNING: no policy specified for oryx/127.12.112.252@KRBTEST.COM; defaulting to no policy
I20260807 22:47:57.373746 19554 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.252@KRBTEST.COM" created.
I20260807 22:47:57.375485 19658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.375699 19554 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:57.375869 19554 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:47:57.375928 19554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal
uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34"
format_stamp: "Formatted at 2026-08-07 22:47:57 on dist-test-slave-tm1g"
server_key: "fd784da9401c29049fb8c2a7eeed70f6"
server_key_iv: "dfbaf422fa0344a0302ba08376940a47"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.377704 19554 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:57.380751 19554 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 22:47:57.380848 19554 log.cc:1196] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 22:47:57.381166 19554 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: Deleting consensus metadata
I20260807 22:47:57.381394 19554 master_runner.cc:315] Copying system tablet from 127.12.112.254:37679
I20260807 22:47:57.382799 19554 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: tablet copy: Beginning tablet copy session from remote peer at address 127.12.112.254:37679
I20260807 22:47:57.391633 19666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.383685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:53962)
0807 22:47:57.383960 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.383975 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.384095 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.384378 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.384381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.384590 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.384705 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.384712 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.385797 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.385802 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.386565 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.386576 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.387100 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.387104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.387188 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.387757 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.387779 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.388099 (+ 320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.389909 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.389912 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.389914 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.390129 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.390540 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.390543 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.390545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.390635 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.391088 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.391090 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.391170 (+ 80us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.391281 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.391427 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":107,"threads_started":1}
I20260807 22:47:57.391625 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.383542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53962 (local address 127.12.112.254:37679)
0807 22:47:57.383677 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.383682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.384078 (+ 396us) server_negotiation.cc:407] Connection header received
0807 22:47:57.384180 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.384185 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.384248 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.384349 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.384840 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.385661 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.386689 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.386979 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.387093 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.388242 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.388246 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.388248 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.388273 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.389791 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.390232 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.390235 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.390237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.390403 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.390734 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.390737 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.390738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.390925 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.391038 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.391342 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.391458 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 22:47:57.392324 19094 tablet_copy_service.cc:140] P 5c5a75799fc34b0a9948786dd415013f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4d29d3d95ddd4e0db7bb585a5b14bb34 ({username='oryx', principal='oryx/127.12.112.253@KRBTEST.COM'} at 127.0.0.1:53962)
I20260807 22:47:57.392500 19094 tablet_copy_service.cc:161] P 5c5a75799fc34b0a9948786dd415013f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4d29d3d95ddd4e0db7bb585a5b14bb34 at {username='oryx', principal='oryx/127.12.112.253@KRBTEST.COM'} at 127.0.0.1:53962: session id = 4d29d3d95ddd4e0db7bb585a5b14bb34-00000000000000000000000000000000
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.252.keytab.
Entry for principal oryx/127.12.112.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.252.keytab.
I20260807 22:47:57.393894 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.252:40587
--webserver_interface=127.12.112.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.252.keytab
--principal=oryx/127.12.112.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:37679,127.12.112.253:46051,127.12.112.252:40587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:47:57.394238 19094 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 22:47:57.395928 19554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 22:47:57.398964 19554 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: tablet copy: Starting download of 0 data blocks...
I20260807 22:47:57.399247 19554 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: tablet copy: Starting download of 1 WAL segments...
I20260807 22:47:57.401207 19554 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 22:47:57.403467 19094 tablet_copy_service.cc:342] P 5c5a75799fc34b0a9948786dd415013f: Request end of tablet copy session 4d29d3d95ddd4e0db7bb585a5b14bb34-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.112.253@KRBTEST.COM'} at 127.0.0.1:53962
I20260807 22:47:57.403610 19094 tablet_copy_service.cc:433] P 5c5a75799fc34b0a9948786dd415013f: ending tablet copy session 4d29d3d95ddd4e0db7bb585a5b14bb34-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4d29d3d95ddd4e0db7bb585a5b14bb34
I20260807 22:47:57.411731 19554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:57.413597 19668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:57.413623 19669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:57.414223 19554 server_base.cc:1034] running on GCE node
W20260807 22:47:57.414429 19671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:57.414654 19554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:57.414949 19554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:57.416137 19554 hybrid_clock.cc:648] HybridClock initialized: now 1786142877416126 us; error 30 us; skew 500 ppm
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:57.417743 19554 init.cc:377] Logged in from keytab as oryx/127.12.112.253@KRBTEST.COM (short username oryx)
I20260807 22:47:57.418192 19554 webserver.cc:460] Webserver started at http://127.12.112.253:38927/ using document root <none> and password file <none>
I20260807 22:47:57.418416 19554 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:57.418463 19554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:57.419801 19554 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:47:57.420816 19678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.421098 19554 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:47:57.421175 19554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal
uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34"
format_stamp: "Formatted at 2026-08-07 22:47:57 on dist-test-slave-tm1g"
server_key: "fd784da9401c29049fb8c2a7eeed70f6"
server_key_iv: "dfbaf422fa0344a0302ba08376940a47"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.421252 19554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:57.436133 19554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:57.438328 19554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:57.443308 19554 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.253:46051
I20260807 22:47:57.443651 19732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.253:46051 every 8 connection(s)
I20260807 22:47:57.443996 19554 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
I20260807 22:47:57.445806 19733 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:47:57.446928 19733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: Bootstrap starting.
I20260807 22:47:57.457577 19733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:47:57.457894 19733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: Bootstrap complete.
I20260807 22:47:57.458588 19733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } }
I20260807 22:47:57.458729 19733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4d29d3d95ddd4e0db7bb585a5b14bb34, State: Initialized, Role: LEARNER
I20260807 22:47:57.458828 19733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } }
I20260807 22:47:57.459276 19733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:57.459270 19736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } } }
I20260807 22:47:57.459549 19736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: This master's current role is: LEARNER
I20260807 22:47:57.462809 19748 catalog_manager.cc:1259] Loaded cluster ID: eca2e9fe0f4340ad8823ad9488ddf6a7
I20260807 22:47:57.462925 19748 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: loading cluster ID for follower catalog manager: success
I20260807 22:47:57.465090 19748 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: acquiring CA information for follower catalog manager: success
I20260807 22:47:57.466601 19748 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 22:47:57.524922 19667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:57.525214 19667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:57.525322 19667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:57.529635 19667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:47:57.529718 19667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:57.529759 19667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:57.529816 19667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:47:57.529856 19667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:47:57.535048 19667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:37679,127.12.112.253:46051,127.12.112.252:40587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.252.keytab
--principal=oryx/127.12.112.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.252:40587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.112.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:57.536090 19667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:57.537109 19667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:57.545531 19754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:57.545535 19755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:57.545590 19667 server_base.cc:1034] running on GCE node
W20260807 22:47:57.545535 19757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:57.546268 19667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:57.547360 19667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:57.548512 19667 hybrid_clock.cc:648] HybridClock initialized: now 1786142877548486 us; error 44 us; skew 500 ppm
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:57.551182 19667 init.cc:377] Logged in from keytab as oryx/127.12.112.252@KRBTEST.COM (short username oryx)
I20260807 22:47:57.551972 19667 webserver.cc:460] Webserver started at http://127.12.112.252:42817/ using document root <none> and password file <none>
I20260807 22:47:57.552511 19667 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:57.552600 19667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:57.552825 19667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:47:57.554853 19667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data/instance:
uuid: "418d1a8f2b094800965c4127658a6804"
format_stamp: "Formatted at 2026-08-07 22:47:57 on dist-test-slave-tm1g"
server_key: "5732caeddde5bde1253862e9bbd39e60"
server_key_iv: "90d60cd9a7a06a71f31dd676de8b589c"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.555428 19667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal/instance:
uuid: "418d1a8f2b094800965c4127658a6804"
format_stamp: "Formatted at 2026-08-07 22:47:57 on dist-test-slave-tm1g"
server_key: "5732caeddde5bde1253862e9bbd39e60"
server_key_iv: "90d60cd9a7a06a71f31dd676de8b589c"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.558964 19667 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:47:57.561455 19764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.562696 19667 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260807 22:47:57.562852 19667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal
uuid: "418d1a8f2b094800965c4127658a6804"
format_stamp: "Formatted at 2026-08-07 22:47:57 on dist-test-slave-tm1g"
server_key: "5732caeddde5bde1253862e9bbd39e60"
server_key_iv: "90d60cd9a7a06a71f31dd676de8b589c"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.563002 19667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:57.573963 19667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:57.576651 19667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:57.576844 19667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:57.583489 19667 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.252:40587
I20260807 22:47:57.583783 19818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.252:40587 every 8 connection(s)
I20260807 22:47:57.584515 19667 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
I20260807 22:47:57.587275 19820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:57.590785 19820 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:47:57.591274 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 19667
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.252@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.112.252@KRBTEST.COM
I20260807 22:47:57.604717 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.592810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53970 (local address 127.12.112.254:37679)
0807 22:47:57.592976 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.592980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.593607 (+ 627us) server_negotiation.cc:407] Connection header received
0807 22:47:57.594491 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.594496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.594554 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.594644 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.595749 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.596586 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.597827 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.598152 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.598267 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.600848 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.600852 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.600856 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.600893 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.602626 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.603159 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.603163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.603165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.603258 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.603612 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.603615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.603617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.603825 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.603938 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.604417 (+ 479us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.604540 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:47:57.605587 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.592819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49782 (local address 127.12.112.252:40587)
0807 22:47:57.593339 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.593356 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.593397 (+ 41us) server_negotiation.cc:407] Connection header received
0807 22:47:57.594215 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.594238 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.594508 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.594698 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.595580 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.596889 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.597732 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.598271 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.598491 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.601467 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.601473 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.601485 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.601508 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.603277 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.603719 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.603726 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.603728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.603810 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.604098 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.604103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.604104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.604320 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.604536 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.605037 (+ 501us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.605164 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"spinlock_wait_cycles":2944,"thread_start_us":149,"threads_started":1}
I20260807 22:47:57.605589 19823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.592819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:53970)
0807 22:47:57.593367 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.593521 (+ 154us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.594215 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.594814 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.594820 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.595243 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.595588 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.595603 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.596729 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.596733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.597728 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.597737 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.598295 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.598297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.598484 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.599027 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.599043 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.600692 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.602757 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.602765 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.602771 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.603043 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.603357 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.603361 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.603363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.603508 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.603938 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.603947 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.604182 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.604370 (+ 188us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.604680 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"spinlock_wait_cycles":29824,"thread_start_us":156,"threads_started":1}
I20260807 22:47:57.606911 19820 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.252@KRBTEST.COM for oryx/127.12.112.253@KRBTEST.COM
I20260807 22:47:57.615607 19823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.607415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:46051 (local address 127.0.0.1:53704)
0807 22:47:57.607790 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.607806 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.607900 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.608188 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.608191 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.608317 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.608406 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.608410 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.609246 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.609248 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.609766 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.609773 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.610196 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.610199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.610270 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.610759 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.610771 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.612106 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.614025 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.614028 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.614029 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.614220 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.614602 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.614606 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.614608 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.614698 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.615090 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.615093 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.615193 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.615308 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.615440 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300}
I20260807 22:47:57.615638 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.607554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53704 (local address 127.12.112.253:46051)
0807 22:47:57.607796 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.607803 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.607851 (+ 48us) server_negotiation.cc:407] Connection header received
0807 22:47:57.608021 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.608024 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.608079 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.608149 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.608507 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.609157 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.609868 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.610100 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.610181 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.612262 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.612266 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.612268 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.612296 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.613914 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.614378 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.614383 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.614385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.614504 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.614802 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.614805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.614807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.614990 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.615100 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.615364 (+ 264us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.615483 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":103,"threads_started":1}
I20260807 22:47:57.616374 19820 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:47:57.617165 19270 heartbeater.cc:503] Master 127.12.112.254:37679 was elected leader, sending a full tablet report...
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.252@KRBTEST.COM for oryx/127.12.112.252@KRBTEST.COM
I20260807 22:47:57.624217 19823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.616799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:40587 (local address 127.0.0.1:49796)
0807 22:47:57.616994 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.617009 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.617096 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.617386 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.617389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.617532 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.617639 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.617646 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.618442 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.618445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.618991 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.618999 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.619415 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.619418 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.619474 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.619903 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.619914 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.621095 (+ 1181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.622847 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.622850 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.622851 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.623033 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.623369 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.623373 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.623374 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.623476 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.623821 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.623823 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.623901 (+ 78us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.623982 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.624078 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 22:47:57.624241 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.616896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49796 (local address 127.12.112.252:40587)
0807 22:47:57.616991 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.616995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.617056 (+ 61us) server_negotiation.cc:407] Connection header received
0807 22:47:57.617203 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.617205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.617239 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.617365 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.617755 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.618244 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.619092 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.619324 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.619401 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.621219 (+ 1818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.621223 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.621225 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.621245 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.622751 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.623140 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.623142 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.623144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.623223 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.623572 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.623575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.623576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.623734 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.623822 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.624037 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.624125 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:47:57.627785 19820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Bootstrap starting.
I20260807 22:47:57.630101 19820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:57.630888 19820 log.cc:824] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:57.632957 19820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: No bootstrap required, opened a new log
I20260807 22:47:57.636554 19820 raft_consensus.cc:348] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } }
I20260807 22:47:57.636770 19820 raft_consensus.cc:374] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:57.636864 19820 raft_consensus.cc:729] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 418d1a8f2b094800965c4127658a6804, State: Initialized, Role: FOLLOWER
I20260807 22:47:57.637334 19820 consensus_queue.cc:260] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } }
I20260807 22:47:57.637830 19827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } } }
I20260807 22:47:57.637943 19827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:47:57.638618 19820 sys_catalog.cc:564] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 22:47:57.643520 19838 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:47:57.643604 19838 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:47:57.646862 19667 master_runner.cc:428] Detected that this master 418d1a8f2b094800965c4127658a6804 is joining an existing cluster
I20260807 22:47:57.646916 19667 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.112.252:40587
I20260807 22:47:57.658596 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.649031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53978 (local address 127.12.112.254:37679)
0807 22:47:57.649172 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.649177 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.649375 (+ 198us) server_negotiation.cc:407] Connection header received
0807 22:47:57.649592 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.649598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.649659 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.649714 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.650461 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.651295 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.653503 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.653863 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.653947 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.655407 (+ 1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.655411 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.655414 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.655440 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.656809 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.657240 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.657244 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.657246 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.657333 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.657623 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.657627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.657629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.657814 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.657942 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.658239 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.658435 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:47:57.659109 19844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.648986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:53978)
0807 22:47:57.649289 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.649304 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.649465 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.649867 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.649870 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.650129 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.650283 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.650294 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.651444 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.651449 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.653350 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.653363 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.654111 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.654113 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.654184 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.654886 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.654900 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.655266 (+ 366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.656929 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.656935 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.656937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.657135 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.657430 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.657433 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.657436 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.657523 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.657932 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.657935 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.658035 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.658766 (+ 731us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.658925 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":52,"thread_start_us":130,"threads_started":1}
I20260807 22:47:57.659240 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 19138
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142876, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.254@KRBTEST.COM for oryx/127.12.112.252@KRBTEST.COM
I20260807 22:47:57.673712 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:44951
--local_ip_for_outbound_sockets=127.12.112.193
--tserver_master_addrs=127.12.112.254:37679
--webserver_port=33895
--webserver_interface=127.12.112.193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab
--principal=oryx/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.112.254:37679,127.12.112.253:46051
--tserver_master_addrs=127.12.112.254:37679,127.12.112.253:46051,127.12.112.252:40587 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:47:57.677794 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.649460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49810 (local address 127.12.112.252:40587)
0807 22:47:57.649560 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.649564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.650029 (+ 465us) server_negotiation.cc:407] Connection header received
0807 22:47:57.650170 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.650173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.650207 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.650252 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.650860 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.651611 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.652825 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.653154 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.653225 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.673926 (+ 20701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.673930 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.673932 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.673954 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.676038 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.676540 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.676547 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.676550 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.676644 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.676953 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.676956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.676958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.677153 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.677218 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.677511 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.677624 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":41}
I20260807 22:47:57.678342 19846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.649644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:40587 (local address 127.0.0.1:49810)
0807 22:47:57.649951 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.649965 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.650080 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.650424 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.650427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.650628 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.650737 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.650745 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.651736 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.651739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.652705 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.652716 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.653362 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.653366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.653449 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.654040 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.654060 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.673778 (+ 19718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.676149 (+ 2371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.676152 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.676154 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.676443 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.676750 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.676753 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.676755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.676847 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.677272 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.677275 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.677358 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.677983 (+ 625us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.678109 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":52,"thread_start_us":76,"threads_started":1}
I20260807 22:47:57.679548 19651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.664642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:40587 (local address 127.0.0.1:49818)
0807 22:47:57.664990 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.665005 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.665083 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.665437 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.665440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.665629 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.665730 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.665736 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.666915 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.666919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.667794 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.667804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.668424 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.668431 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.668586 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.669083 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.669102 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.670794 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.676965 (+ 6171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.676968 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.676970 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.677523 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.678209 (+ 686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.678213 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.678215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.678333 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.679032 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.679037 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.679146 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.679230 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.679376 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269}
I20260807 22:47:57.680032 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.649046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53710 (local address 127.12.112.253:46051)
0807 22:47:57.649174 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.649180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.649663 (+ 483us) server_negotiation.cc:407] Connection header received
0807 22:47:57.649824 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.649826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.649873 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.649940 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.650622 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.651385 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.652831 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.653196 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.653272 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.676106 (+ 22834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.676111 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.676114 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.676148 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.678049 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.678631 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.678638 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.678643 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.678738 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.679072 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.679075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.679077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.679302 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.679381 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.679735 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.679870 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:47:57.680311 19845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.649256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:46051 (local address 127.0.0.1:53710)
0807 22:47:57.649590 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.649602 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.649720 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.650091 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.650094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.650340 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.650501 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.650508 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.651512 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.651514 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.652665 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.652680 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.653425 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.653431 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.653531 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.673628 (+ 20097us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.673649 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.675881 (+ 2232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.678166 (+ 2285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.678172 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.678177 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.678525 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.678854 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.678857 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.678859 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.678969 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.679443 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.679446 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.679530 (+ 84us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.679744 (+ 214us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.679904 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":115,"thread_start_us":96,"threads_started":1}
I20260807 22:47:57.680620 19847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.664695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49818 (local address 127.12.112.252:40587)
0807 22:47:57.665070 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.665082 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.665102 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:47:57.665206 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.665212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.665306 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.665427 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.665859 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.666781 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.667950 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.668296 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.668413 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.671009 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.671015 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.671021 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.671053 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.676828 (+ 5775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.677659 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.677662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.677664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.677763 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.678683 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.678689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.678693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.678911 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.679919 (+ 1008us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.679989 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.680302 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":152,"threads_started":1}
I20260807 22:47:57.681529 19073 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.112.252:40587: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "418d1a8f2b094800965c4127658a6804"
member_type: NON_VOTER
last_known_addr {
host: "127.12.112.252"
port: 40587
}
attrs {
promote: true
}
}
dest_uuid: "5c5a75799fc34b0a9948786dd415013f"
cas_config_opid_index: 5
I20260807 22:47:57.682175 19073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } }
I20260807 22:47:57.683585 19653 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 418d1a8f2b094800965c4127658a6804 (127.12.112.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.683804 19791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:57.685066 19653 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.112.252:40587
I20260807 22:47:57.685165 19791 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 FOLLOWER]: Refusing update from remote peer 5c5a75799fc34b0a9948786dd415013f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 22:47:57.685238 19653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.685343 19653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:57.685686 19667 master.cc:537] Master@127.12.112.252:40587 shutting down...
I20260807 22:47:57.685880 19654 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Connected to new peer: Peer: permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 22:47:57.688367 19059 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f -> Peer 418d1a8f2b094800965c4127658a6804 (127.12.112.252:40587): Couldn't send request to peer 418d1a8f2b094800965c4127658a6804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 22:47:57.690223 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.683596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53720 (local address 127.12.112.253:46051)
0807 22:47:57.683700 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.683704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.685978 (+ 2274us) server_negotiation.cc:407] Connection header received
0807 22:47:57.686030 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.686033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.686094 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.686190 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:57.686723 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.687430 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.689254 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.689686 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.689814 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.689959 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.690042 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.690105 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:47:57.690222 19651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.683350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:46051 (local address 127.0.0.1:53720)
0807 22:47:57.685641 (+ 2291us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.685657 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.685735 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.686480 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.686483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.686503 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:57.686591 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.686596 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.687542 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.687547 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.688743 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.688753 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.689814 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.689818 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.689904 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.689946 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.690029 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.690103 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2207}
I20260807 22:47:57.691066 19706 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 LEARNER]: Refusing update from remote peer 5c5a75799fc34b0a9948786dd415013f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 22:47:57.691536 19654 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 22:47:57.692080 19667 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:57.692369 19667 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:57.692502 19667 tablet_replica.cc:330] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: stopping tablet replica
I20260807 22:47:57.693509 19706 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 418d1a8f2b094800965c4127658a6804 (127.12.112.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.695416 19736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c5a75799fc34b0a9948786dd415013f. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.695544 19736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: This master's current role is: LEARNER
I20260807 22:47:57.695648 19736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: NON_VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: true } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.695767 19736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: This master's current role is: LEARNER
I20260807 22:47:57.695819 19654 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f: attempting to promote NON_VOTER 4d29d3d95ddd4e0db7bb585a5b14bb34 to VOTER
I20260807 22:47:57.696269 19654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } }
I20260807 22:47:57.697621 19706 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 LEARNER]: Refusing update from remote peer 5c5a75799fc34b0a9948786dd415013f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 22:47:57.698004 19653 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260807 22:47:57.698129 19059 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f -> Peer 418d1a8f2b094800965c4127658a6804 (127.12.112.252:40587): Couldn't send request to peer 418d1a8f2b094800965c4127658a6804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 22:47:57.700129 19654 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 4d29d3d95ddd4e0db7bb585a5b14bb34 (127.12.112.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.701817 19654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.701941 19654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:57.702250 19653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.702427 19653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:57.702672 19706 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 4d29d3d95ddd4e0db7bb585a5b14bb34 (127.12.112.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.704036 19850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.704162 19850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:47:57.712731 19667 master.cc:552] Master@127.12.112.252:40587 shutdown complete.
I20260807 22:47:57.712833 19667 master_runner.cc:305] Clearing existing system tablet
I20260807 22:47:57.713090 19667 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:57.713173 19667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:57.714582 19667 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:47:57.715559 19854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.715835 19667 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:57.715999 19667 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:47:57.716038 19667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal
uuid: "418d1a8f2b094800965c4127658a6804"
format_stamp: "Formatted at 2026-08-07 22:47:57 on dist-test-slave-tm1g"
server_key: "5732caeddde5bde1253862e9bbd39e60"
server_key_iv: "90d60cd9a7a06a71f31dd676de8b589c"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.717906 19667 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:57.720237 19667 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 22:47:57.720364 19667 log.cc:1196] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 22:47:57.720623 19667 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Deleting consensus metadata
I20260807 22:47:57.720919 19667 master_runner.cc:315] Copying system tablet from 127.12.112.254:37679
I20260807 22:47:57.722294 19667 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: tablet copy: Beginning tablet copy session from remote peer at address 127.12.112.254:37679
I20260807 22:47:57.731338 19860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.722936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:53986)
0807 22:47:57.723281 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.723293 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.723455 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.723750 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.723753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.723988 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.724110 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.724117 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.724952 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.724958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.725604 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.725612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.726292 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.726320 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.726433 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.727061 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.727074 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.727536 (+ 462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.729582 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.729587 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.729589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.729819 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.730132 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.730135 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.730137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.730230 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.730707 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.730710 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.730832 (+ 122us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.730945 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.731126 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":101,"threads_started":1}
I20260807 22:47:57.731326 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.723024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53986 (local address 127.12.112.254:37679)
0807 22:47:57.723169 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.723174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.723387 (+ 213us) server_negotiation.cc:407] Connection header received
0807 22:47:57.723585 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.723588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.723645 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.723731 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.724258 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.724830 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.725772 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.726100 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.726222 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.727692 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.727696 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.727698 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.727736 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.729461 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.729927 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.729931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.729933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.730029 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.730377 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.730384 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.730388 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.730603 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.730720 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.731004 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.731131 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:47:57.732247 19094 tablet_copy_service.cc:140] P 5c5a75799fc34b0a9948786dd415013f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 418d1a8f2b094800965c4127658a6804 ({username='oryx', principal='oryx/127.12.112.252@KRBTEST.COM'} at 127.0.0.1:53986)
I20260807 22:47:57.732378 19094 tablet_copy_service.cc:161] P 5c5a75799fc34b0a9948786dd415013f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 418d1a8f2b094800965c4127658a6804 at {username='oryx', principal='oryx/127.12.112.252@KRBTEST.COM'} at 127.0.0.1:53986: session id = 418d1a8f2b094800965c4127658a6804-00000000000000000000000000000000
I20260807 22:47:57.733359 19094 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 22:47:57.734727 19667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 22:47:57.736910 19667 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: tablet copy: Starting download of 0 data blocks...
I20260807 22:47:57.737152 19667 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: tablet copy: Starting download of 1 WAL segments...
I20260807 22:47:57.738970 19667 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 22:47:57.745048 19094 tablet_copy_service.cc:342] P 5c5a75799fc34b0a9948786dd415013f: Request end of tablet copy session 418d1a8f2b094800965c4127658a6804-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.112.252@KRBTEST.COM'} at 127.0.0.1:53986
I20260807 22:47:57.745172 19094 tablet_copy_service.cc:433] P 5c5a75799fc34b0a9948786dd415013f: ending tablet copy session 418d1a8f2b094800965c4127658a6804-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 418d1a8f2b094800965c4127658a6804
I20260807 22:47:57.756002 19667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:57.757809 19864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:57.758040 19861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:57.758355 19862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:57.758447 19667 server_base.cc:1034] running on GCE node
I20260807 22:47:57.758584 19667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:57.758914 19667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:57.760032 19667 hybrid_clock.cc:648] HybridClock initialized: now 1786142877760020 us; error 32 us; skew 500 ppm
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:57.761811 19667 init.cc:377] Logged in from keytab as oryx/127.12.112.252@KRBTEST.COM (short username oryx)
I20260807 22:47:57.762377 19667 webserver.cc:460] Webserver started at http://127.12.112.252:38837/ using document root <none> and password file <none>
I20260807 22:47:57.762591 19667 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:57.762650 19667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:57.764005 19667 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:47:57.765025 19873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.765287 19667 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:47:57.765407 19667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal
uuid: "418d1a8f2b094800965c4127658a6804"
format_stamp: "Formatted at 2026-08-07 22:47:57 on dist-test-slave-tm1g"
server_key: "5732caeddde5bde1253862e9bbd39e60"
server_key_iv: "90d60cd9a7a06a71f31dd676de8b589c"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.765518 19667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:57.769876 19667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:57.772058 19667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:57.777174 19667 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.252:40587
I20260807 22:47:57.777943 19667 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
I20260807 22:47:57.778460 19926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.252:40587 every 8 connection(s)
I20260807 22:47:57.779659 19927 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:47:57.780552 19927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Bootstrap starting.
I20260807 22:47:57.790066 19927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:47:57.790450 19927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Bootstrap complete.
I20260807 22:47:57.791034 19927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } }
I20260807 22:47:57.791183 19927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 418d1a8f2b094800965c4127658a6804, State: Initialized, Role: LEARNER
I20260807 22:47:57.791299 19927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } }
I20260807 22:47:57.791672 19931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:57.791842 19927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:47:57.791857 19931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: This master's current role is: LEARNER
I20260807 22:47:57.794983 19942 catalog_manager.cc:1259] Loaded cluster ID: eca2e9fe0f4340ad8823ad9488ddf6a7
I20260807 22:47:57.795120 19942 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: loading cluster ID for follower catalog manager: success
I20260807 22:47:57.797065 19942 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: acquiring CA information for follower catalog manager: success
I20260807 22:47:57.798286 19942 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:47:57.839006 19406 heartbeater.cc:503] Master 127.12.112.254:37679 was elected leader, sending a full tablet report...
W20260807 22:47:57.857112 19848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:57.857439 19848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:57.857532 19848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:57.862177 19848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:57.862270 19848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:57.862396 19848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:47:57.868213 19848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab
--principal=oryx/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:44951
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=33895
--tserver_master_addrs=127.12.112.254:37679,127.12.112.253:46051,127.12.112.252:40587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:57.869535 19848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:57.870771 19848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:47:57.881213 19848 server_base.cc:1034] running on GCE node
W20260807 22:47:57.881158 19948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:57.881174 19947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:57.881151 19950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:57.881842 19848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:57.882671 19848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:57.883859 19848 hybrid_clock.cc:648] HybridClock initialized: now 1786142877883829 us; error 49 us; skew 500 ppm
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:57.886816 19848 init.cc:377] Logged in from keytab as oryx/127.12.112.193@KRBTEST.COM (short username oryx)
I20260807 22:47:57.887714 19848 webserver.cc:460] Webserver started at http://127.12.112.193:33895/ using document root <none> and password file <none>
I20260807 22:47:57.888270 19848 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:57.888348 19848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:57.892809 19848 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:47:57.895282 19957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.896739 19848 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:47:57.896858 19848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "5d7ff18bd59840aaac2fd2fed2d15683"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "43ee0a8ed504efb2aed1decbd304d2d9"
server_key_iv: "79b5fd1583385aadb7d3f2555d851306"
server_key_version: "encryptionkey@0"
I20260807 22:47:57.897441 19848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:57.932512 19848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:57.935945 19848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:57.936122 19848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:57.936734 19848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:57.937640 19848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:57.937692 19848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.937732 19848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:57.937748 19848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:57.948000 19848 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:44951
I20260807 22:47:57.948050 20074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:44951 every 8 connection(s)
I20260807 22:47:57.949075 19848 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:47:57.954226 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 19848
I20260807 22:47:57.954469 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 19275
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.252@KRBTEST.COM
I20260807 22:47:57.967808 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.950952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:60001 (local address 127.12.112.252:40587)
0807 22:47:57.951261 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.951265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.952149 (+ 884us) server_negotiation.cc:407] Connection header received
0807 22:47:57.953283 (+ 1134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.953287 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.953351 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.953464 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.956117 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.957181 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.958792 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.959179 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.959266 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.963639 (+ 4373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.963642 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.963645 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.963682 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.965341 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.965967 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.965973 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.965978 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.966065 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.966475 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.966478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.966480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.966725 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.966847 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.967462 (+ 615us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.967622 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":117,"threads_started":1}
I20260807 22:47:57.967928 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.952729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:52179 (local address 127.12.112.254:37679)
0807 22:47:57.952881 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.952886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.952903 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:47:57.953285 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.953289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.953347 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.953400 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.955548 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.956474 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.959080 (+ 2606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.959581 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.959713 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.963119 (+ 3406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.963123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.963127 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.963164 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.965138 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.965912 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.965916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.965921 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.966040 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.966540 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.966543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.966545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.966753 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.966847 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.967503 (+ 656us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.967667 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:47:57.968870 20082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.952526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.193:52179)
0807 22:47:57.952793 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.952807 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.953096 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.953647 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.953654 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.954356 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.955385 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.955396 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.956694 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.956701 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.958869 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.958884 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.959980 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.959987 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.960190 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.960809 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.960829 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.962925 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.965290 (+ 2365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.965298 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.965316 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.965792 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.966150 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.966153 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.966155 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.966402 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.966859 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.966867 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.967206 (+ 339us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.968160 (+ 954us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.968365 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":810,"spinlock_wait_cycles":5760,"thread_start_us":98,"threads_started":1}
I20260807 22:47:57.968870 20080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.951474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:40587 (local address 127.12.112.193:60001)
0807 22:47:57.951988 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.952042 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.953070 (+ 1028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.953647 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.953653 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.954367 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.955957 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.955969 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.957337 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.957343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.958649 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.958663 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.959479 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.959485 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.959736 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.960483 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.960518 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.963481 (+ 2963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.965468 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.965474 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.965479 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.965860 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.966176 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.966179 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.966181 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.966386 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.966937 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.966940 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.967201 (+ 261us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.967405 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.967803 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":79,"spinlock_wait_cycles":44800,"thread_start_us":126,"threads_started":1}
I20260807 22:47:57.970275 20076 heartbeater.cc:347] Connected to a master server at 127.12.112.254:37679
I20260807 22:47:57.970387 20075 heartbeater.cc:347] Connected to a master server at 127.12.112.252:40587
I20260807 22:47:57.970585 20076 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:57.970584 20075 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:57.971294 20076 heartbeater.cc:511] Master 127.12.112.254:37679 requested a full tablet report, sending...
I20260807 22:47:57.971294 20075 heartbeater.cc:511] Master 127.12.112.252:40587 requested a full tablet report, sending...
I20260807 22:47:57.971786 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:44085
--local_ip_for_outbound_sockets=127.12.112.194
--tserver_master_addrs=127.12.112.254:37679
--webserver_port=39551
--webserver_interface=127.12.112.194
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab
--principal=oryx/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.112.254:37679,127.12.112.253:46051
--tserver_master_addrs=127.12.112.254:37679,127.12.112.253:46051,127.12.112.252:40587 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:47:57.972760 19073 ts_manager.cc:194] Re-registered known tserver with Master: 5d7ff18bd59840aaac2fd2fed2d15683 (127.12.112.193:44951)
I20260807 22:47:57.973255 19891 ts_manager.cc:194] Registered new tserver with Master: 5d7ff18bd59840aaac2fd2fed2d15683 (127.12.112.193:44951)
I20260807 22:47:57.973506 19073 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:52179
Aug 07 22:47:57 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142877, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.253@KRBTEST.COM
I20260807 22:47:57.978153 20081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.951474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:46051 (local address 127.12.112.193:52833)
0807 22:47:57.951988 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:57.952042 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:57.953082 (+ 1040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:57.953647 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:57.953654 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:57.954356 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:57.955123 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.955149 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.966881 (+ 11732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.966884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.971146 (+ 4262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:57.971156 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.971937 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.971944 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:57.972080 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.972607 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:57.972627 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:57.974236 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:57.976608 (+ 2372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.976611 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.976612 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.976803 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.977156 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:57.977158 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:57.977159 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:57.977229 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:57.977730 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:57.977732 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:57.977809 (+ 77us) client_negotiation.cc:769] Sending connection context
0807 22:47:57.977886 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:47:57.978012 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":3375,"spinlock_wait_cycles":27648,"thread_start_us":123,"threads_started":1}
I20260807 22:47:57.978569 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:57.950935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:52833 (local address 127.12.112.253:46051)
0807 22:47:57.951082 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:57.951086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:57.952155 (+ 1069us) server_negotiation.cc:407] Connection header received
0807 22:47:57.953389 (+ 1234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:57.953393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:57.953445 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:57.953522 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:57.965876 (+ 12354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.966700 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.971286 (+ 4586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:57.971648 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:57.971768 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:57.974579 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:57.974584 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:57.974589 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:57.974628 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:57.976484 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.976935 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.976941 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.976946 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.977058 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:57.977336 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:57.977343 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:57.977347 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:57.977617 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:57.977740 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:57.978011 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 22:47:57.978160 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:47:57.979521 20077 heartbeater.cc:347] Connected to a master server at 127.12.112.253:46051
I20260807 22:47:57.979612 20077 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:57.979859 20077 heartbeater.cc:511] Master 127.12.112.253:46051 requested a full tablet report, sending...
I20260807 22:47:57.980935 19687 ts_manager.cc:194] Registered new tserver with Master: 5d7ff18bd59840aaac2fd2fed2d15683 (127.12.112.193:44951)
I20260807 22:47:58.057202 19549 heartbeater.cc:503] Master 127.12.112.254:37679 was elected leader, sending a full tablet report...
W20260807 22:47:58.089417 20083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:58.089704 20083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:58.089775 20083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:58.094098 20083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:58.094182 20083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:58.094271 20083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:47:58.099639 20083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab
--principal=oryx/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:44085
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=39551
--tserver_master_addrs=127.12.112.254:37679,127.12.112.253:46051,127.12.112.252:40587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:58.100783 20083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:58.101918 20083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:58.112002 20089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:58.111999 20088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:58.112006 20091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:58.112301 20083 server_base.cc:1034] running on GCE node
I20260807 22:47:58.112736 20083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:58.113425 20083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:58.114581 20083 hybrid_clock.cc:648] HybridClock initialized: now 1786142878114569 us; error 30 us; skew 500 ppm
Aug 07 22:47:58 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142878, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:58.117408 20083 init.cc:377] Logged in from keytab as oryx/127.12.112.194@KRBTEST.COM (short username oryx)
I20260807 22:47:58.118229 20083 webserver.cc:460] Webserver started at http://127.12.112.194:39551/ using document root <none> and password file <none>
I20260807 22:47:58.118815 20083 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:58.118947 20083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:58.123060 20083 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:47:58.125121 20099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:58.126680 20083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:47:58.126812 20083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "aac3f5763d42421f9c82fc39a01d991a"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "232a966e559a710ea448f31ac7f0700f"
server_key_iv: "836d828457ec2f00278c0cd02fcc3cf8"
server_key_version: "encryptionkey@0"
I20260807 22:47:58.127388 20083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:58.148335 20083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:58.151912 20083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:58.152123 20083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:58.152752 20083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:58.153638 20083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:58.153710 20083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:58.153782 20083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:58.153832 20083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:58.163678 20083 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:44085
I20260807 22:47:58.163686 20215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:44085 every 8 connection(s)
I20260807 22:47:58.164709 20083 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:47:58.170830 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 20083
I20260807 22:47:58.171042 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 19411
Aug 07 22:47:58 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142878, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.252@KRBTEST.COM
Aug 07 22:47:58 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142878, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:47:58.180099 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:44531
--local_ip_for_outbound_sockets=127.12.112.195
--tserver_master_addrs=127.12.112.254:37679
--webserver_port=35903
--webserver_interface=127.12.112.195
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab
--principal=oryx/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.112.254:37679,127.12.112.253:46051
--tserver_master_addrs=127.12.112.254:37679,127.12.112.253:46051,127.12.112.252:40587 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:47:58 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142878, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.253@KRBTEST.COM
I20260807 22:47:58.183605 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.168328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:53897 (local address 127.12.112.252:40587)
0807 22:47:58.168461 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.168467 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.168534 (+ 67us) server_negotiation.cc:407] Connection header received
0807 22:47:58.168941 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.168945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.169015 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.169070 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.171215 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.172051 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.174108 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.174441 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.174507 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.178755 (+ 4248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.178759 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.178762 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.178791 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.180835 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.181556 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.181559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.181561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.181650 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.182110 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.182115 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.182116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.182401 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.182488 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.183265 (+ 777us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.183425 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:47:58.184572 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.166696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:50171 (local address 127.12.112.254:37679)
0807 22:47:58.166851 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.166855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.167805 (+ 950us) server_negotiation.cc:407] Connection header received
0807 22:47:58.168959 (+ 1154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.168963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.169020 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.169099 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.171213 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.172058 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.174105 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.174557 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.174704 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.178755 (+ 4051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.178759 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.178762 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.178791 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.181004 (+ 2213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.181556 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.181559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.181561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.181649 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.183385 (+ 1736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.183390 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.183392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.183666 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.183743 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.184304 (+ 561us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.184425 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:47:58.185297 20220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.167144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.194:50171)
0807 22:47:58.167644 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.167698 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.168746 (+ 1048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.169273 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.169281 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.169872 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:58.171028 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.171049 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.172254 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.172257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.173964 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.173975 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.174713 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.174717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.175045 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.176003 (+ 958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:58.176014 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:58.178553 (+ 2539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:58.181160 (+ 2607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.181163 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.181165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.181442 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.181766 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.181769 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.181771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.181989 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.184026 (+ 2037us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:58.184029 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:58.184114 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.184756 (+ 642us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.184904 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":328,"spinlock_wait_cycles":90496,"thread_start_us":120,"threads_started":1}
I20260807 22:47:58.185545 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.168182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:40587 (local address 127.12.112.194:53897)
0807 22:47:58.168460 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.168474 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.168748 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.169273 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.169281 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.169872 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:58.171064 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.171070 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.172254 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.172257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.173964 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.173975 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.174713 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.174717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.175046 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.175957 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:58.175984 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:58.178553 (+ 2569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:58.180981 (+ 2428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.180988 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.181004 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.181435 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.181766 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.181769 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.181771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.181989 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.182581 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:58.182589 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:58.182944 (+ 355us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.183788 (+ 844us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.184152 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":358,"spinlock_wait_cycles":19328,"thread_start_us":88,"threads_started":1}
I20260807 22:47:58.186892 20216 heartbeater.cc:347] Connected to a master server at 127.12.112.252:40587
I20260807 22:47:58.186990 20217 heartbeater.cc:347] Connected to a master server at 127.12.112.254:37679
I20260807 22:47:58.187142 20216 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:58.187143 20217 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:58.187769 20216 heartbeater.cc:511] Master 127.12.112.252:40587 requested a full tablet report, sending...
I20260807 22:47:58.187773 20217 heartbeater.cc:511] Master 127.12.112.254:37679 requested a full tablet report, sending...
I20260807 22:47:58.188961 19073 ts_manager.cc:194] Re-registered known tserver with Master: aac3f5763d42421f9c82fc39a01d991a (127.12.112.194:44085)
I20260807 22:47:58.188987 19891 ts_manager.cc:194] Registered new tserver with Master: aac3f5763d42421f9c82fc39a01d991a (127.12.112.194:44085)
I20260807 22:47:58.189262 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.166770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:45981 (local address 127.12.112.253:46051)
0807 22:47:58.166925 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.166930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.167807 (+ 877us) server_negotiation.cc:407] Connection header received
0807 22:47:58.169231 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.169234 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.169313 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.169415 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.178375 (+ 8960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.179247 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.180644 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.181055 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.181151 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.183995 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.184001 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.184007 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.184041 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.186414 (+ 2373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.187142 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.187146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.187149 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.187249 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.188082 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.188088 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.188093 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.188369 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.188456 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.188875 (+ 419us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.189034 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 22:47:58.189733 19073 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:50171
I20260807 22:47:58.189954 20221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.167144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:46051 (local address 127.12.112.194:45981)
0807 22:47:58.167644 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.167698 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.168730 (+ 1032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.169436 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.169439 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.169870 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:58.178168 (+ 8298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.178180 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.179420 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.179423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.180492 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.180507 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.181356 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.181362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.181484 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.182022 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:58.182042 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:58.183815 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:58.186695 (+ 2880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.186701 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.186706 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.187049 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.187821 (+ 772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.187827 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.187832 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.187945 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.188543 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:58.188549 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:58.188659 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.189485 (+ 826us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.189653 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":66,"spinlock_wait_cycles":29056,"thread_start_us":157,"threads_started":1}
I20260807 22:47:58.190582 20218 heartbeater.cc:347] Connected to a master server at 127.12.112.253:46051
I20260807 22:47:58.190658 20218 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:58.190820 20218 heartbeater.cc:511] Master 127.12.112.253:46051 requested a full tablet report, sending...
I20260807 22:47:58.191916 19687 ts_manager.cc:194] Registered new tserver with Master: aac3f5763d42421f9c82fc39a01d991a (127.12.112.194:44085)
I20260807 22:47:58.218225 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.213707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49832 (local address 127.12.112.252:40587)
0807 22:47:58.213871 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.213877 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.213949 (+ 72us) server_negotiation.cc:407] Connection header received
0807 22:47:58.214080 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.214083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.214151 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.214279 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:58.214580 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.215460 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.217211 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.217650 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.217746 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.217848 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.218052 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.218116 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 22:47:58.218271 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.213601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:40587 (local address 127.0.0.1:49832)
0807 22:47:58.213859 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.213872 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.213974 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.214284 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.214286 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.214334 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:58.214465 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.214470 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.215659 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.215663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.217074 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.217087 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.217789 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.217794 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.217904 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.217934 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.218020 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.218107 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":86,"threads_started":1}
I20260807 22:47:58.219072 19901 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 22:47:58.219537 19931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c5a75799fc34b0a9948786dd415013f. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:58.219708 19931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: This master's current role is: LEARNER
W20260807 22:47:58.303624 20223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:47:58.303910 20223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:47:58.303980 20223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:47:58.308296 20223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:47:58.308368 20223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:47:58.308449 20223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:47:58.313759 20223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab
--principal=oryx/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:44531
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=35903
--tserver_master_addrs=127.12.112.254:37679,127.12.112.253:46051,127.12.112.252:40587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:47:58.314980 20223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:47:58.316068 20223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:47:58.326042 20235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:47:58.326099 20233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:58.326263 20223 server_base.cc:1034] running on GCE node
W20260807 22:47:58.326050 20232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:47:58.326885 20223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:47:58.327666 20223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:47:58.328840 20223 hybrid_clock.cc:648] HybridClock initialized: now 1786142878328826 us; error 25 us; skew 500 ppm
Aug 07 22:47:58 dist-test-slave-tm1g krb5kdc[19026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142878, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:47:58.331815 20223 init.cc:377] Logged in from keytab as oryx/127.12.112.195@KRBTEST.COM (short username oryx)
I20260807 22:47:58.332737 20223 webserver.cc:460] Webserver started at http://127.12.112.195:35903/ using document root <none> and password file <none>
I20260807 22:47:58.333262 20223 fs_manager.cc:359] Metadata directory not provided
I20260807 22:47:58.333338 20223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:47:58.337198 20223 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260807 22:47:58.339308 20242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:58.340572 20223 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:47:58.340718 20223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "fdd31fe8f1934b1e88d94741df87b368"
format_stamp: "Formatted at 2026-08-07 22:47:56 on dist-test-slave-tm1g"
server_key: "6d5e036cab98141dbb0cc0990b5be5ae"
server_key_iv: "29e21d78d82d63b244d95544b7362405"
server_key_version: "encryptionkey@0"
I20260807 22:47:58.341290 20223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:47:58.354622 20223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:47:58.357457 20223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:47:58.357667 20223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:47:58.358274 20223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:47:58.359284 20223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:47:58.359355 20223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:58.359428 20223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:47:58.359465 20223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:47:58.369431 20223 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:44531
I20260807 22:47:58.369514 20357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:44531 every 8 connection(s)
I20260807 22:47:58.370621 20223 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:47:58.378048 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 20223
Aug 07 22:47:58 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142878, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.252@KRBTEST.COM
Aug 07 22:47:58 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142878, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.253@KRBTEST.COM
Aug 07 22:47:58 dist-test-slave-tm1g krb5kdc[19026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142878, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:47:58.389047 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.372404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:59071 (local address 127.12.112.254:37679)
0807 22:47:58.372539 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.372544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.373522 (+ 978us) server_negotiation.cc:407] Connection header received
0807 22:47:58.375102 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.375104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.375149 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.375244 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.376337 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.376882 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.378292 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.378637 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.378725 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.383660 (+ 4935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.383664 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.383667 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.383697 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.386184 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.387231 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.387236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.387239 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.387339 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.387689 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.387696 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.387697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.387932 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.388040 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.388766 (+ 726us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.388886 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:47:58.391018 20363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.372882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.195:59071)
0807 22:47:58.373367 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.373421 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.374569 (+ 1148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.375271 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.375274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.375564 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:58.376182 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.376196 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.377030 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.377038 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.378130 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.378144 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.378955 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.378959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.379195 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.380227 (+ 1032us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:58.380249 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:58.383470 (+ 3221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:58.386345 (+ 2875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.386350 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.386352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.386610 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.387463 (+ 853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.387468 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.387472 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.387566 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.388104 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:58.388113 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:58.388473 (+ 360us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.389520 (+ 1047us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.389866 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":102,"spinlock_wait_cycles":72320,"thread_start_us":153,"threads_started":1}
I20260807 22:47:58.392102 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.372445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:36767 (local address 127.12.112.253:46051)
0807 22:47:58.372648 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.372653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.373535 (+ 882us) server_negotiation.cc:407] Connection header received
0807 22:47:58.374831 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.374835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.374897 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.374976 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.376356 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.377169 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.378678 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.379010 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.379082 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.387220 (+ 8138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.387224 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.387227 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.387250 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.389254 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.389801 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.389804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.389806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.389899 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.390256 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.390259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.390261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.390513 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.390596 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.391813 (+ 1217us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.391936 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260807 22:47:58.392483 20359 heartbeater.cc:347] Connected to a master server at 127.12.112.254:37679
I20260807 22:47:58.392772 20359 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:58.393342 20359 heartbeater.cc:511] Master 127.12.112.254:37679 requested a full tablet report, sending...
I20260807 22:47:58.393472 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.374075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:36953 (local address 127.12.112.252:40587)
0807 22:47:58.374200 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.374204 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.374367 (+ 163us) server_negotiation.cc:407] Connection header received
0807 22:47:58.375435 (+ 1068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.375440 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.375504 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.375595 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.376354 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.377176 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.378621 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.378974 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.379067 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.383865 (+ 4798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.383869 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.383872 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.383897 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.385737 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.386489 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.386493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.386495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.386588 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.387075 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.387078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.387080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.387338 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.387446 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.392887 (+ 5441us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.393011 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:47:58.393543 20366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.373912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:40587 (local address 127.12.112.195:36953)
0807 22:47:58.374181 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.374194 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.374565 (+ 371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.375635 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.375640 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.375804 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:58.376200 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.376209 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.377323 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.377326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.378475 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.378487 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.379230 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.379234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.379481 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.380096 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:58.380108 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:58.383716 (+ 3608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:58.385872 (+ 2156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.385878 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.385894 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.386374 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.386714 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.386718 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.386720 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.386907 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.392524 (+ 5617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:58.392527 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:58.392616 (+ 89us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.392713 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.393291 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":229,"spinlock_wait_cycles":1792,"thread_start_us":103,"threads_started":1}
I20260807 22:47:58.393996 20372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.380615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48496 (local address 127.12.112.254:37679)
0807 22:47:58.382136 (+ 1521us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.382140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.382592 (+ 452us) server_negotiation.cc:407] Connection header received
0807 22:47:58.382640 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.382645 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.382703 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.382784 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.383761 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.384571 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.385867 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.386239 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.386371 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.388591 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.388597 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.388602 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.388634 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.390457 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.390980 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.390983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.390984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.391459 (+ 475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.391827 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.391830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.391831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.392045 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.392230 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.393699 (+ 1469us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.393827 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1448,"thread_start_us":68,"threads_started":1}
I20260807 22:47:58.394430 20358 heartbeater.cc:347] Connected to a master server at 127.12.112.252:40587
I20260807 22:47:58.394518 20358 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:58.394519 19074 ts_manager.cc:194] Re-registered known tserver with Master: fdd31fe8f1934b1e88d94741df87b368 (127.12.112.195:44531)
I20260807 22:47:58.394677 20358 heartbeater.cc:511] Master 127.12.112.252:40587 requested a full tablet report, sending...
I20260807 22:47:58.395093 20362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.372882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:46051 (local address 127.12.112.195:36767)
0807 22:47:58.373367 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.373420 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.374565 (+ 1145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.375141 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.375148 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.375544 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:47:58.376201 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.376209 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.377323 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.377326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.378554 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.378563 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.379236 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.379239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.379484 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.380054 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:47:58.380080 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:47:58.387064 (+ 6984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:47:58.389389 (+ 2325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.389394 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.389398 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.389668 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.390039 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:47:58.390042 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:47:58.390044 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:47:58.390135 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:47:58.390659 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:47:58.390662 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:47:58.390760 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.392266 (+ 1506us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.392418 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":294,"spinlock_wait_cycles":22272,"thread_start_us":152,"threads_started":1}
I20260807 22:47:58.395217 19074 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:59071
I20260807 22:47:58.395428 19891 ts_manager.cc:194] Registered new tserver with Master: fdd31fe8f1934b1e88d94741df87b368 (127.12.112.195:44531)
I20260807 22:47:58.396538 20360 heartbeater.cc:347] Connected to a master server at 127.12.112.253:46051
I20260807 22:47:58.396632 20360 heartbeater.cc:464] Registering TS with master...
I20260807 22:47:58.396806 20360 heartbeater.cc:511] Master 127.12.112.253:46051 requested a full tablet report, sending...
I20260807 22:47:58.398383 19687 ts_manager.cc:194] Registered new tserver with Master: fdd31fe8f1934b1e88d94741df87b368 (127.12.112.195:44531)
I20260807 22:47:58.399576 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.381318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48514 (local address 127.12.112.252:40587)
0807 22:47:58.381979 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.381983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.382899 (+ 916us) server_negotiation.cc:407] Connection header received
0807 22:47:58.382946 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.382949 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.382995 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.383072 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.388440 (+ 5368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.389164 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.390235 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.390591 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.390687 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.395487 (+ 4800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.395492 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.395496 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.395528 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.397587 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.398080 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.398083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.398084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.398171 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.398608 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.398612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.398613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.398835 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.398994 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.399233 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.399402 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":77,"threads_started":1}
I20260807 22:47:58.399941 20371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.380431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48450 (local address 127.12.112.253:46051)
0807 22:47:58.381154 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.381159 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.381542 (+ 383us) server_negotiation.cc:407] Connection header received
0807 22:47:58.381578 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.381580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.381620 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.381732 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.382597 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.383477 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.384793 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.385209 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.385347 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.387320 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.387324 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.387326 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.387353 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.397822 (+ 10469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.398381 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.398385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.398386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.398473 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.398774 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.398777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.398779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.398977 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.399093 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.399667 (+ 574us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.399789 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":85,"threads_started":1}
I20260807 22:47:58.397131 19074 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:47:58.401487 19074 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:47:58.404129 19851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: NON_VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: true } } }
I20260807 22:47:58.404269 19851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:58.409996 19851 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f: attempting to promote NON_VOTER 418d1a8f2b094800965c4127658a6804 to VOTER
I20260807 22:47:58.410382 19851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } }
I20260807 22:47:58.411540 19901 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 LEARNER]: Refusing update from remote peer 5c5a75799fc34b0a9948786dd415013f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 22:47:58.411711 19706 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Refusing update from remote peer 5c5a75799fc34b0a9948786dd415013f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 22:47:58.411957 20380 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Connected to new peer: Peer: permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 22:47:58.412102 19851 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 22:47:58.413950 20380 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 418d1a8f2b094800965c4127658a6804 (127.12.112.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:47:58.414497 19706 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 418d1a8f2b094800965c4127658a6804 (127.12.112.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:47:58.414835 19901 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 418d1a8f2b094800965c4127658a6804 (127.12.112.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:47:58.415625 20380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:47:58.415752 20380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:58.416541 19931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:47:58.416675 19931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:47:58.416893 20380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:47:58.416989 20380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:58.417073 20380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:47:58.417143 20380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f [sys.catalog]: This master's current role is: LEADER
I20260807 22:47:58.419080 20389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c5a75799fc34b0a9948786dd415013f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:47:58.419229 20389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:47:58.423405 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.418044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44951 (local address 127.0.0.1:36942)
0807 22:47:58.418165 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.418182 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.418262 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.419050 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.419054 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.419073 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:58.419177 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.419185 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.420727 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.420731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.421882 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.421891 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.423000 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.423004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.423097 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.423129 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.423182 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.423266 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 22:47:58.423782 20390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.418119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44531 (local address 127.0.0.1:38488)
0807 22:47:58.418395 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.418411 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.418497 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.419916 (+ 1419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.419919 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.419937 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:58.420021 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.420027 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.421266 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.421271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.422333 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.422344 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.423351 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.423355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.423444 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.423475 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.423566 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.423644 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":123,"threads_started":1}
I20260807 22:47:58.424252 20391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.418252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36942 (local address 127.12.112.193:44951)
0807 22:47:58.418551 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.418569 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.418590 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:47:58.418666 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.418671 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.418877 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.419343 (+ 466us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:58.419491 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.420606 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.422005 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.422870 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.423756 (+ 886us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.423988 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.424029 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.424098 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":132,"threads_started":1}
I20260807 22:47:58.424369 20392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.418487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:44085 (local address 127.0.0.1:59602)
0807 22:47:58.418709 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.418723 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.418832 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.420153 (+ 1321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.420155 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.420169 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:58.420239 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.420243 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.421619 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.421622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.422738 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.422749 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.423973 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.423977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.424080 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.424101 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.424181 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.424263 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":96,"threads_started":1}
I20260807 22:47:58.424495 20394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.419023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59602 (local address 127.12.112.194:44085)
0807 22:47:58.419513 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.419531 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.419554 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:47:58.419628 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.419636 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.419838 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.419992 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:58.420367 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.421487 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.422888 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.423672 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.423795 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.423911 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.424227 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.424337 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":141,"threads_started":1}
I20260807 22:47:58.424548 20393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.418919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38488 (local address 127.12.112.195:44531)
0807 22:47:58.419475 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.419487 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.419508 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:47:58.419579 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.419583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.419757 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.420156 (+ 399us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:58.420285 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.421147 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.422443 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.423233 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.423368 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.423498 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.423686 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.423792 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":102,"threads_started":1}
I20260807 22:47:58.427167 20006 tablet_service.cc:1467] Processing CreateTablet for tablet 69420c5e92154f34a2bc9b848828713b (DEFAULT_TABLE table=test-table [id=4fcf4ae3852048fe861dd70d1923e7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:58.427165 20290 tablet_service.cc:1467] Processing CreateTablet for tablet 69420c5e92154f34a2bc9b848828713b (DEFAULT_TABLE table=test-table [id=4fcf4ae3852048fe861dd70d1923e7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:58.428121 20290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69420c5e92154f34a2bc9b848828713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:58.428122 20006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69420c5e92154f34a2bc9b848828713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:58.434890 20395 tablet_bootstrap.cc:492] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: Bootstrap starting.
I20260807 22:47:58.435840 20396 tablet_bootstrap.cc:492] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: Bootstrap starting.
I20260807 22:47:58.436493 20148 tablet_service.cc:1467] Processing CreateTablet for tablet 69420c5e92154f34a2bc9b848828713b (DEFAULT_TABLE table=test-table [id=4fcf4ae3852048fe861dd70d1923e7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:47:58.437562 20148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69420c5e92154f34a2bc9b848828713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:47:58.437822 20396 tablet_bootstrap.cc:654] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:58.437829 20395 tablet_bootstrap.cc:654] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:58.438642 20396 log.cc:824] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:58.438685 20395 log.cc:824] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:58.440657 20396 tablet_bootstrap.cc:492] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: No bootstrap required, opened a new log
I20260807 22:47:58.440657 20395 tablet_bootstrap.cc:492] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: No bootstrap required, opened a new log
I20260807 22:47:58.440842 20395 ts_tablet_manager.cc:1397] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:47:58.440842 20396 ts_tablet_manager.cc:1397] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 22:47:58.445060 20396 raft_consensus.cc:348] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } } peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } }
I20260807 22:47:58.445348 20396 raft_consensus.cc:374] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:58.445464 20396 raft_consensus.cc:729] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdd31fe8f1934b1e88d94741df87b368, State: Initialized, Role: FOLLOWER
I20260807 22:47:58.445911 20396 consensus_queue.cc:260] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } } peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } }
I20260807 22:47:58.445851 20395 raft_consensus.cc:348] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } } peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } }
I20260807 22:47:58.446082 20395 raft_consensus.cc:374] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:58.446141 20395 raft_consensus.cc:729] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7ff18bd59840aaac2fd2fed2d15683, State: Initialized, Role: FOLLOWER
I20260807 22:47:58.446583 20395 consensus_queue.cc:260] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } } peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } }
I20260807 22:47:58.446998 20396 ts_tablet_manager.cc:1428] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:47:58.447314 20359 heartbeater.cc:503] Master 127.12.112.254:37679 was elected leader, sending a full tablet report...
I20260807 22:47:58.447510 20395 ts_tablet_manager.cc:1428] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 22:47:58.448493 20076 heartbeater.cc:503] Master 127.12.112.254:37679 was elected leader, sending a full tablet report...
W20260807 22:47:58.450661 20078 tablet.cc:2369] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:47:58.451346 20399 tablet_bootstrap.cc:492] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: Bootstrap starting.
I20260807 22:47:58.454098 20399 tablet_bootstrap.cc:654] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: Neither blocks nor log segments found. Creating new log.
I20260807 22:47:58.455078 20399 log.cc:824] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:47:58.457737 20399 tablet_bootstrap.cc:492] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: No bootstrap required, opened a new log
I20260807 22:47:58.457955 20399 ts_tablet_manager.cc:1397] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.003s
I20260807 22:47:58.461791 20399 raft_consensus.cc:348] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } } peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } }
I20260807 22:47:58.462033 20399 raft_consensus.cc:374] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:47:58.462114 20399 raft_consensus.cc:729] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac3f5763d42421f9c82fc39a01d991a, State: Initialized, Role: FOLLOWER
I20260807 22:47:58.462579 20399 consensus_queue.cc:260] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } } peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } }
I20260807 22:47:58.463547 20399 ts_tablet_manager.cc:1428] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:47:58.463985 20217 heartbeater.cc:503] Master 127.12.112.254:37679 was elected leader, sending a full tablet report...
I20260807 22:47:58.509675 20403 raft_consensus.cc:482] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:47:58.510020 20403 raft_consensus.cc:504] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } } peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } }
I20260807 22:47:58.511265 20403 leader_election.cc:288] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdd31fe8f1934b1e88d94741df87b368 (127.12.112.195:44531), 5d7ff18bd59840aaac2fd2fed2d15683 (127.12.112.193:44951)
I20260807 22:47:58.515938 20391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.511735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:38239 (local address 127.12.112.193:44951)
0807 22:47:58.511890 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.511895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.511909 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:47:58.512058 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.512061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.512115 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.512198 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:58.512486 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.512989 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.514639 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.515251 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.515382 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.515434 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.515736 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.515820 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 22:47:58.515938 20393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.511651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:42727 (local address 127.12.112.195:44531)
0807 22:47:58.511793 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.511800 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.511817 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:47:58.512001 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.512009 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.512051 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.512135 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:47:58.512431 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.512956 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.514639 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.515251 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.515382 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.515434 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.515736 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.515809 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:47:58.515959 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.511560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44531 (local address 127.12.112.194:42727)
0807 22:47:58.511753 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.511769 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.511878 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.512148 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.512151 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.512167 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:58.512318 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.512324 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.513079 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.513085 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.514500 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.514512 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.515380 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.515383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.515571 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.515622 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.515703 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.515789 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":133}
I20260807 22:47:58.515959 20221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.511560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44951 (local address 127.12.112.194:38239)
0807 22:47:58.511801 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:58.511818 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:47:58.511920 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:47:58.512206 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:47:58.512209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:47:58.512224 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:47:58.512372 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.512377 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.513126 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.513129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.514507 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:47:58.514513 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.515380 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.515383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:47:58.515584 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.515628 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 22:47:58.515703 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 22:47:58.515789 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":219}
I20260807 22:47:58.516806 20027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69420c5e92154f34a2bc9b848828713b" candidate_uuid: "aac3f5763d42421f9c82fc39a01d991a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" is_pre_election: true
I20260807 22:47:58.517009 20312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69420c5e92154f34a2bc9b848828713b" candidate_uuid: "aac3f5763d42421f9c82fc39a01d991a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdd31fe8f1934b1e88d94741df87b368" is_pre_election: true
I20260807 22:47:58.517129 20027 raft_consensus.cc:2454] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac3f5763d42421f9c82fc39a01d991a in term 0.
I20260807 22:47:58.517314 20312 raft_consensus.cc:2454] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac3f5763d42421f9c82fc39a01d991a in term 0.
I20260807 22:47:58.517668 20101 leader_election.cc:302] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7ff18bd59840aaac2fd2fed2d15683, aac3f5763d42421f9c82fc39a01d991a; no voters:
I20260807 22:47:58.517954 20403 raft_consensus.cc:2781] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:47:58.518047 20403 raft_consensus.cc:482] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:47:58.518080 20403 raft_consensus.cc:3037] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:58.519258 20403 raft_consensus.cc:504] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } } peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } }
I20260807 22:47:58.519656 20403 leader_election.cc:288] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [CANDIDATE]: Term 1 election: Requested vote from peers fdd31fe8f1934b1e88d94741df87b368 (127.12.112.195:44531), 5d7ff18bd59840aaac2fd2fed2d15683 (127.12.112.193:44951)
I20260807 22:47:58.519976 20312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69420c5e92154f34a2bc9b848828713b" candidate_uuid: "aac3f5763d42421f9c82fc39a01d991a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdd31fe8f1934b1e88d94741df87b368"
I20260807 22:47:58.520042 20027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69420c5e92154f34a2bc9b848828713b" candidate_uuid: "aac3f5763d42421f9c82fc39a01d991a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7ff18bd59840aaac2fd2fed2d15683"
I20260807 22:47:58.520097 20312 raft_consensus.cc:3037] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:58.520192 20027 raft_consensus.cc:3037] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:47:58.521129 20312 raft_consensus.cc:2454] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac3f5763d42421f9c82fc39a01d991a in term 1.
I20260807 22:47:58.521376 20027 raft_consensus.cc:2454] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac3f5763d42421f9c82fc39a01d991a in term 1.
I20260807 22:47:58.521427 20103 leader_election.cc:302] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac3f5763d42421f9c82fc39a01d991a, fdd31fe8f1934b1e88d94741df87b368; no voters:
I20260807 22:47:58.521610 20403 raft_consensus.cc:2781] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:47:58.521862 20403 raft_consensus.cc:686] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 1 LEADER]: Becoming Leader. State: Replica: aac3f5763d42421f9c82fc39a01d991a, State: Running, Role: LEADER
I20260807 22:47:58.522358 20403 consensus_queue.cc:237] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } } peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } }
I20260807 22:47:58.525878 19074 catalog_manager.cc:5495] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a reported cstate change: term changed from 0 to 1, leader changed from <none> to aac3f5763d42421f9c82fc39a01d991a (127.12.112.194). New cstate: current_term: 1 leader_uuid: "aac3f5763d42421f9c82fc39a01d991a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } health_report { overall_health: UNKNOWN } } }
I20260807 22:47:58.546137 20394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.542623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59614 (local address 127.12.112.194:44085)
0807 22:47:58.542756 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.542761 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.542773 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:47:58.542867 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.542869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.542924 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.543025 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:47:58.543313 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.543808 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.544672 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.544900 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.544981 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.545230 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:47:58.545766 (+ 536us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:47:58.545855 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.545964 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.546012 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:47:58.552153 20027 raft_consensus.cc:1261] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683 [term 1 FOLLOWER]: Refusing update from remote peer aac3f5763d42421f9c82fc39a01d991a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:58.552907 20312 raft_consensus.cc:1261] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368 [term 1 FOLLOWER]: Refusing update from remote peer aac3f5763d42421f9c82fc39a01d991a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:47:58.553050 20404 consensus_queue.cc:1035] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:58.553545 20404 consensus_queue.cc:1035] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:47:58.563464 20410 mvcc.cc:205] Tried to move back new op lower bound from 7316041230541844480 to 7316041230430171136. Current Snapshot: MvccSnapshot[applied={T|T < 7316041230541844480}]
I20260807 22:47:58.565042 20409 mvcc.cc:205] Tried to move back new op lower bound from 7316041230541844480 to 7316041230430171136. Current Snapshot: MvccSnapshot[applied={T|T < 7316041230541844480}]
I20260807 22:47:58.574126 19073 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:58.574328 19073 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:47:58.578696 19073 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5c5a75799fc34b0a9948786dd415013f: Sending DeleteTablet for 3 replicas of tablet 69420c5e92154f34a2bc9b848828713b
I20260807 22:47:58.579528 20006 tablet_service.cc:1514] Processing DeleteTablet for tablet 69420c5e92154f34a2bc9b848828713b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:58 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:36942
I20260807 22:47:58.579843 20148 tablet_service.cc:1514] Processing DeleteTablet for tablet 69420c5e92154f34a2bc9b848828713b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:58 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:59602
I20260807 22:47:58.580295 20418 tablet_replica.cc:330] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: stopping tablet replica
I20260807 22:47:58.580359 20290 tablet_service.cc:1514] Processing DeleteTablet for tablet 69420c5e92154f34a2bc9b848828713b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:47:58 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:38488
I20260807 22:47:58.580729 20418 raft_consensus.cc:2229] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:47:58.580922 20419 tablet_replica.cc:330] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: stopping tablet replica
I20260807 22:47:58.581216 20419 raft_consensus.cc:2229] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:58.581346 20418 raft_consensus.cc:2258] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:58.581538 20417 tablet_replica.cc:330] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: stopping tablet replica
I20260807 22:47:58.581823 20417 raft_consensus.cc:2229] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:47:58.582151 20417 raft_consensus.cc:2258] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:58.582619 20419 raft_consensus.cc:2258] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:47:58.583825 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 19039
I20260807 22:47:58.585453 20418 ts_tablet_manager.cc:1905] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:58.586122 20417 ts_tablet_manager.cc:1905] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:58.586537 20419 ts_tablet_manager.cc:1905] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:47:58.588907 20417 ts_tablet_manager.cc:1918] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:47:58.589012 20417 log.cc:1196] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/69420c5e92154f34a2bc9b848828713b
I20260807 22:47:58.589335 20417 ts_tablet_manager.cc:1939] T 69420c5e92154f34a2bc9b848828713b P 5d7ff18bd59840aaac2fd2fed2d15683: Deleting consensus metadata
I20260807 22:47:58.593489 20418 ts_tablet_manager.cc:1918] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:47:58.593676 20418 log.cc:1196] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/69420c5e92154f34a2bc9b848828713b
W20260807 22:47:58.594084 19961 connection.cc:535] server connection from 127.0.0.1:36942 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 22:47:58.595207 20418 ts_tablet_manager.cc:1939] T 69420c5e92154f34a2bc9b848828713b P aac3f5763d42421f9c82fc39a01d991a: Deleting consensus metadata
I20260807 22:47:58.595345 20419 ts_tablet_manager.cc:1918] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:47:58.595515 20419 log.cc:1196] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/69420c5e92154f34a2bc9b848828713b
I20260807 22:47:58.595914 20419 ts_tablet_manager.cc:1939] T 69420c5e92154f34a2bc9b848828713b P fdd31fe8f1934b1e88d94741df87b368: Deleting consensus metadata
W20260807 22:47:58.597155 20100 connection.cc:441] server connection from 127.0.0.1:59602 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59602 (request call id 1) could send its response
W20260807 22:47:58.599014 20246 connection.cc:441] server connection from 127.0.0.1:38488 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38488 (request call id 1) could send its response
I20260807 22:47:58.603379 20371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.582122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48462 (local address 127.12.112.253:46051)
0807 22:47:58.582393 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.582400 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.590768 (+ 8368us) server_negotiation.cc:407] Connection header received
0807 22:47:58.590987 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.590990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.591046 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.591100 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.592165 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.593022 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.594270 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.594672 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.594748 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.596689 (+ 1941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.596693 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.596696 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.596724 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.598587 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.599121 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.599124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.599126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.599221 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.599541 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.599544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.599546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.599779 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.599920 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.603070 (+ 3150us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.603213 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260807 22:47:58.609642 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.598425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48540 (local address 127.12.112.252:40587)
0807 22:47:58.598562 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.598566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.599429 (+ 863us) server_negotiation.cc:407] Connection header received
0807 22:47:58.599545 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.599548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.599606 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.599690 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.600861 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.601685 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.602868 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.603221 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.603294 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.605300 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.605305 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.605308 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.605340 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.607711 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.608231 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.608234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.608236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.608326 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.608626 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.608629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.608630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.608860 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.608985 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.609352 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.609474 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:47:58.610481 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.598731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48466 (local address 127.12.112.253:46051)
0807 22:47:58.598853 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.598857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.599882 (+ 1025us) server_negotiation.cc:407] Connection header received
0807 22:47:58.600046 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.600048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.600091 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.600144 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.601126 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.601950 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.603204 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.603530 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.603605 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.606487 (+ 2882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.606492 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.606496 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.606525 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.608255 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.608737 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.608741 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.608742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.608816 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.609133 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.609136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.609138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.609359 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.609472 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.610050 (+ 578us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.610168 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:47:58.610773 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:58.582234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48526 (local address 127.12.112.252:40587)
0807 22:47:58.582492 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 22:47:58.582496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:47:58.600900 (+ 18404us) server_negotiation.cc:407] Connection header received
0807 22:47:58.600947 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:47:58.600951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:47:58.601000 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:47:58.601075 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:47:58.601952 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.602838 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.604757 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:47:58.605131 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:47:58.605228 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:47:58.607005 (+ 1777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:47:58.607009 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:47:58.607012 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:47:58.607039 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:47:58.608900 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.609367 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.609371 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.609372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.609455 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:47:58.609735 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:47:58.609738 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:47:58.609740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:47:58.609940 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:47:58.610048 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:47:58.610511 (+ 463us) server_negotiation.cc:299] Negotiation successful
0807 22:47:58.610623 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":188}
I20260807 22:47:59.564483 20428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:59.563812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.194:34551)
0807 22:47:59.564238 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:59.564354 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":207,"threads_started":1}
W20260807 22:47:59.564971 20217 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:37679 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
I20260807 22:47:59.566659 20429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:59.566031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.195:39489)
0807 22:47:59.566445 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:59.566557 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":83,"threads_started":1}
W20260807 22:47:59.566972 20359 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:37679 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
I20260807 22:47:59.567142 20430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:47:59.566679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.193:33007)
0807 22:47:59.566944 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 22:47:59.567038 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":64,"threads_started":1}
W20260807 22:47:59.567412 20076 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:37679 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
I20260807 22:48:00.079803 20431 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5c5a75799fc34b0a9948786dd415013f)
I20260807 22:48:00.080044 20431 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } }
I20260807 22:48:00.080382 20432 raft_consensus.cc:482] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5c5a75799fc34b0a9948786dd415013f)
I20260807 22:48:00.080567 20432 raft_consensus.cc:504] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } }
I20260807 22:48:00.081197 20431 leader_election.cc:288] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679), 418d1a8f2b094800965c4127658a6804 (127.12.112.252:40587)
I20260807 22:48:00.081453 20432 leader_election.cc:288] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679), 4d29d3d95ddd4e0db7bb585a5b14bb34 (127.12.112.253:46051)
I20260807 22:48:00.081964 20433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.081397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:48942)
0807 22:48:00.081756 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.081850 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":62,"threads_started":1}
I20260807 22:48:00.082046 20434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.081569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:48954)
0807 22:48:00.081850 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.081922 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":60,"threads_started":1}
W20260807 22:48:00.082242 19681 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
W20260807 22:48:00.082327 19876 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
I20260807 22:48:00.083277 20434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.083023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:48956)
0807 22:48:00.083164 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.083211 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 22:48:00.083290 20433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.083039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:48958)
0807 22:48:00.083167 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.083222 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260807 22:48:00.083384 19681 leader_election.cc:334] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679): Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
W20260807 22:48:00.083514 19876 leader_election.cc:334] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679): Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
I20260807 22:48:00.085866 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.081705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:40587 (local address 127.0.0.1:48556)
0807 22:48:00.082342 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.082356 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:00.082452 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:00.083008 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:00.083011 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:00.083030 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:00.083126 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:00.083134 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:00.084054 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:00.084057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:00.084817 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:00.084826 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:00.085473 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:00.085476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:00.085564 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:00.085589 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:48:00.085649 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 22:48:00.085739 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":74,"threads_started":1}
I20260807 22:48:00.085918 20438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.082053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48556 (local address 127.12.112.252:40587)
0807 22:48:00.082633 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:00.082637 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:00.082650 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:48:00.082695 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:00.082699 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:00.082747 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:00.082833 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:00.083253 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:00.083920 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:00.084938 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:00.085359 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:00.085485 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:00.085537 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:00.085684 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 22:48:00.085757 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":509,"spinlock_wait_cycles":13056,"thread_start_us":62,"threads_started":1}
I20260807 22:48:00.085879 20437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.081869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48478 (local address 127.12.112.253:46051)
0807 22:48:00.082132 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:00.082137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:00.082508 (+ 371us) server_negotiation.cc:407] Connection header received
0807 22:48:00.082567 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:00.082572 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:00.082618 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:00.082698 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:00.083160 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:00.083902 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:00.084975 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:00.085365 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:00.085492 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:00.085541 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:00.085732 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 22:48:00.085791 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":74,"threads_started":1}
I20260807 22:48:00.085922 20435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.081618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:46051 (local address 127.0.0.1:48478)
0807 22:48:00.082256 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.082270 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:00.082399 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:00.082827 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:00.082830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:00.082864 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:00.083022 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:00.083030 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:00.084017 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:00.084022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:00.084825 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:00.084833 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:00.085504 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:00.085507 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:00.085598 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:00.085612 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 22:48:00.085704 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 22:48:00.085758 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":34,"spinlock_wait_cycles":5120,"thread_start_us":46,"threads_started":1}
I20260807 22:48:00.086604 19901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "418d1a8f2b094800965c4127658a6804" is_pre_election: true
I20260807 22:48:00.086745 19706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "418d1a8f2b094800965c4127658a6804" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" is_pre_election: true
I20260807 22:48:00.086840 19901 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d29d3d95ddd4e0db7bb585a5b14bb34 in term 1.
I20260807 22:48:00.086907 19706 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 418d1a8f2b094800965c4127658a6804 in term 1.
I20260807 22:48:00.087168 19681 leader_election.cc:302] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 418d1a8f2b094800965c4127658a6804, 4d29d3d95ddd4e0db7bb585a5b14bb34; no voters: 5c5a75799fc34b0a9948786dd415013f
I20260807 22:48:00.087249 19877 leader_election.cc:302] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 418d1a8f2b094800965c4127658a6804, 4d29d3d95ddd4e0db7bb585a5b14bb34; no voters: 5c5a75799fc34b0a9948786dd415013f
I20260807 22:48:00.087407 20431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 22:48:00.087472 20432 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 22:48:00.087486 20431 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5c5a75799fc34b0a9948786dd415013f)
I20260807 22:48:00.087530 20431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:48:00.087528 20432 raft_consensus.cc:482] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5c5a75799fc34b0a9948786dd415013f)
I20260807 22:48:00.087571 20432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:48:00.088569 20431 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } }
I20260807 22:48:00.088577 20432 raft_consensus.cc:504] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } }
I20260807 22:48:00.088843 20431 leader_election.cc:288] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [CANDIDATE]: Term 2 election: Requested vote from peers 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679), 418d1a8f2b094800965c4127658a6804 (127.12.112.252:40587)
I20260807 22:48:00.088918 20432 leader_election.cc:288] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 2 election: Requested vote from peers 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679), 4d29d3d95ddd4e0db7bb585a5b14bb34 (127.12.112.253:46051)
I20260807 22:48:00.089201 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.089004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:48970)
0807 22:48:00.089091 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.089142 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 22:48:00.089355 19901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "418d1a8f2b094800965c4127658a6804"
I20260807 22:48:00.089416 19706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "418d1a8f2b094800965c4127658a6804" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34"
I20260807 22:48:00.089548 19901 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d29d3d95ddd4e0db7bb585a5b14bb34 in current term 2: Already voted for candidate 418d1a8f2b094800965c4127658a6804 in this term.
I20260807 22:48:00.089560 19706 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 418d1a8f2b094800965c4127658a6804 in current term 2: Already voted for candidate 4d29d3d95ddd4e0db7bb585a5b14bb34 in this term.
I20260807 22:48:00.089887 20435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.089038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:48982)
0807 22:48:00.089780 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.089831 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":679}
I20260807 22:48:00.090436 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.090191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:48992)
0807 22:48:00.090322 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.090375 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 22:48:00.090526 20435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.090296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:48996)
0807 22:48:00.090404 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.090455 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 22:48:00.090552 19681 leader_election.cc:334] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679): Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
I20260807 22:48:00.090629 19681 leader_election.cc:302] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d29d3d95ddd4e0db7bb585a5b14bb34; no voters: 418d1a8f2b094800965c4127658a6804, 5c5a75799fc34b0a9948786dd415013f
I20260807 22:48:00.090785 20431 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 22:48:00.090883 19876 leader_election.cc:334] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679): Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
I20260807 22:48:00.090956 19876 leader_election.cc:302] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 418d1a8f2b094800965c4127658a6804; no voters: 4d29d3d95ddd4e0db7bb585a5b14bb34, 5c5a75799fc34b0a9948786dd415013f
I20260807 22:48:00.091104 20432 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 22:48:00.566241 20441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.565698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.194:36047)
0807 22:48:00.566046 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.566119 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":101,"threads_started":1}
I20260807 22:48:00.568137 20442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.567676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.195:57919)
0807 22:48:00.567963 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.568033 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":93,"threads_started":1}
I20260807 22:48:00.568409 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:00.567937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.193:55947)
0807 22:48:00.568246 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:00.568315 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":77,"threads_started":1}
I20260807 22:48:01.567601 20444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.567091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.194:48193)
0807 22:48:01.567390 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.567475 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":103,"threads_started":1}
I20260807 22:48:01.569206 20445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.568759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.195:37293)
0807 22:48:01.569015 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.569083 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":82,"threads_started":1}
I20260807 22:48:01.569669 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.569275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.193:49351)
0807 22:48:01.569544 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.569591 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":68,"threads_started":1}
I20260807 22:48:01.673274 20447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:48:01.673424 20447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } }
I20260807 22:48:01.673904 20447 leader_election.cc:288] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679), 4d29d3d95ddd4e0db7bb585a5b14bb34 (127.12.112.253:46051)
I20260807 22:48:01.674369 19706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "418d1a8f2b094800965c4127658a6804" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" is_pre_election: true
I20260807 22:48:01.674530 20448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.674067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:49170)
0807 22:48:01.674338 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.674405 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260807 22:48:01.674538 19706 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 418d1a8f2b094800965c4127658a6804 in term 2.
I20260807 22:48:01.674834 19877 leader_election.cc:302] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 418d1a8f2b094800965c4127658a6804, 4d29d3d95ddd4e0db7bb585a5b14bb34; no voters:
I20260807 22:48:01.675045 20447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 22:48:01.675117 20447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:48:01.675161 20447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:48:01.675357 20448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.675110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:49184)
0807 22:48:01.675237 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.675293 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 22:48:01.675542 19876 leader_election.cc:334] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679): Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
I20260807 22:48:01.676376 20447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } }
I20260807 22:48:01.676712 20447 leader_election.cc:288] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 3 election: Requested vote from peers 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679), 4d29d3d95ddd4e0db7bb585a5b14bb34 (127.12.112.253:46051)
I20260807 22:48:01.676972 20448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.676783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:49196)
0807 22:48:01.676871 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.676923 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 22:48:01.677062 19706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "418d1a8f2b094800965c4127658a6804" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34"
I20260807 22:48:01.677182 19706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:48:01.677695 20448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.677496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:49200)
0807 22:48:01.677595 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.677640 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 22:48:01.677793 19876 leader_election.cc:334] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679): Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
I20260807 22:48:01.678227 19706 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 418d1a8f2b094800965c4127658a6804 in term 3.
I20260807 22:48:01.678536 19877 leader_election.cc:302] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 418d1a8f2b094800965c4127658a6804, 4d29d3d95ddd4e0db7bb585a5b14bb34; no voters: 5c5a75799fc34b0a9948786dd415013f
I20260807 22:48:01.678771 20447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 22:48:01.679005 20447 raft_consensus.cc:686] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [term 3 LEADER]: Becoming Leader. State: Replica: 418d1a8f2b094800965c4127658a6804, State: Running, Role: LEADER
I20260807 22:48:01.679284 20447 consensus_queue.cc:237] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } }
I20260807 22:48:01.680729 20450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 418d1a8f2b094800965c4127658a6804. Latest consensus state: current_term: 3 leader_uuid: "418d1a8f2b094800965c4127658a6804" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:48:01.680855 20450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:01.681243 20452 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:48:01.683521 20452 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:48:01.683866 20452 catalog_manager.cc:1259] Loaded cluster ID: eca2e9fe0f4340ad8823ad9488ddf6a7
I20260807 22:48:01.683909 20452 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:48:01.684420 20452 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:48:01.684751 20452 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Loaded TSK: 0
I20260807 22:48:01.685393 20452 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:48:01.751291 19891 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:48:01.754529 19891 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:48:01.757477 20448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.757242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:49224)
0807 22:48:01.757361 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.757410 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 22:48:01.757627 19706 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [term 3 FOLLOWER]: Refusing update from remote peer 418d1a8f2b094800965c4127658a6804: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260807 22:48:01.758179 20448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.757965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.0.0.1:49230)
0807 22:48:01.758073 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.758121 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 22:48:01.758160 20447 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260807 22:48:01.758399 19876 consensus_peers.cc:487] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 -> Peer 5c5a75799fc34b0a9948786dd415013f (127.12.112.254:37679): Couldn't send request to peer 5c5a75799fc34b0a9948786dd415013f. Status: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 22:48:01.759757 20454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 418d1a8f2b094800965c4127658a6804. Latest consensus state: current_term: 3 leader_uuid: "418d1a8f2b094800965c4127658a6804" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:48:01.759943 20454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:48:01.761163 20447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "418d1a8f2b094800965c4127658a6804" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:48:01.761294 20447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804 [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:01.761448 20454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "418d1a8f2b094800965c4127658a6804" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5c5a75799fc34b0a9948786dd415013f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 37679 } } peers { permanent_uuid: "4d29d3d95ddd4e0db7bb585a5b14bb34" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 46051 } attrs { promote: false } } peers { permanent_uuid: "418d1a8f2b094800965c4127658a6804" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 40587 } attrs { promote: false } } }
I20260807 22:48:01.761602 20454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d29d3d95ddd4e0db7bb585a5b14bb34 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:48:01.772680 20448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.767694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44951 (local address 127.0.0.1:36954)
0807 22:48:01.768254 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.768271 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:01.768362 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:01.769235 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:01.769242 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:01.769261 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:01.769380 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:01.769387 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.770564 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.770567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:01.771437 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:01.771447 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.772191 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.772195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:01.772344 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:01.772367 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:48:01.772462 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 22:48:01.772543 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":88}
I20260807 22:48:01.772680 20460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.767805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36954 (local address 127.12.112.193:44951)
0807 22:48:01.768948 (+ 1143us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:01.768951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:01.768962 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:48:01.769037 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:01.769042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:01.769101 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:01.769516 (+ 415us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:01.769640 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.770412 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.771572 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.772075 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.772193 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:01.772243 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:01.772484 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 22:48:01.772562 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1074,"thread_start_us":84,"threads_started":1}
I20260807 22:48:01.773164 20461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.767975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44531 (local address 127.0.0.1:38496)
0807 22:48:01.768709 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.768723 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:01.769117 (+ 394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:01.769476 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:01.769481 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:01.769509 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:01.769601 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:01.769606 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.770557 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.770560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:01.771780 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:01.771790 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.772758 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.772761 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:01.772863 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:01.772885 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:48:01.772956 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 22:48:01.773034 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"mutex_wait_us":23,"thread_start_us":91,"threads_started":1}
I20260807 22:48:01.773319 20006 tablet_service.cc:1467] Processing CreateTablet for tablet d60b508c1ffd4a05a4c5bc38513a544a (DEFAULT_TABLE table=test-table [id=9e9cb2366fad416fac65369bd449634d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:01.773543 20463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.768290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:44085 (local address 127.0.0.1:59630)
0807 22:48:01.768928 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.768944 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:01.769036 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:01.769269 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:01.769273 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:01.769299 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:01.769416 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:01.769422 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.771178 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.771181 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:01.772235 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:01.772244 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.773154 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.773157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:01.773263 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:01.773290 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:48:01.773356 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 22:48:01.773422 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":6,"spinlock_wait_cycles":2304,"thread_start_us":100,"threads_started":1}
I20260807 22:48:01.773623 20462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.768142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38496 (local address 127.12.112.195:44531)
0807 22:48:01.768567 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:01.768575 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:01.768796 (+ 221us) server_negotiation.cc:407] Connection header received
0807 22:48:01.769223 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:01.769227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:01.769281 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:01.769363 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:01.769725 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.770259 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.771910 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.772550 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.772657 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:01.772701 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:01.773407 (+ 706us) server_negotiation.cc:299] Negotiation successful
0807 22:48:01.773483 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":94,"threads_started":1}
I20260807 22:48:01.773697 20006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d60b508c1ffd4a05a4c5bc38513a544a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:01.773949 20464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.768509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59630 (local address 127.12.112.194:44085)
0807 22:48:01.768765 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:01.768770 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:01.769021 (+ 251us) server_negotiation.cc:407] Connection header received
0807 22:48:01.769113 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:01.769117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:01.769176 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:01.769259 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:01.769542 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.770430 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.772336 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:01.772951 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:01.773055 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:01.773101 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:01.773749 (+ 648us) server_negotiation.cc:299] Negotiation successful
0807 22:48:01.773844 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":72,"threads_started":1}
I20260807 22:48:01.774489 20148 tablet_service.cc:1467] Processing CreateTablet for tablet d60b508c1ffd4a05a4c5bc38513a544a (DEFAULT_TABLE table=test-table [id=9e9cb2366fad416fac65369bd449634d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:01.774749 20148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d60b508c1ffd4a05a4c5bc38513a544a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:01.774829 20290 tablet_service.cc:1467] Processing CreateTablet for tablet d60b508c1ffd4a05a4c5bc38513a544a (DEFAULT_TABLE table=test-table [id=9e9cb2366fad416fac65369bd449634d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:01.775071 20290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d60b508c1ffd4a05a4c5bc38513a544a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:01.776139 20465 tablet_bootstrap.cc:492] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683: Bootstrap starting.
I20260807 22:48:01.777208 20465 tablet_bootstrap.cc:654] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:01.777321 20466 tablet_bootstrap.cc:492] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a: Bootstrap starting.
I20260807 22:48:01.777717 20467 tablet_bootstrap.cc:492] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: Bootstrap starting.
I20260807 22:48:01.778158 20466 tablet_bootstrap.cc:654] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:01.778630 20467 tablet_bootstrap.cc:654] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:01.779397 20466 tablet_bootstrap.cc:492] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a: No bootstrap required, opened a new log
I20260807 22:48:01.779482 20466 ts_tablet_manager.cc:1397] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 22:48:01.779771 20467 tablet_bootstrap.cc:492] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: No bootstrap required, opened a new log
I20260807 22:48:01.779881 20467 ts_tablet_manager.cc:1397] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:48:01.779867 20466 raft_consensus.cc:348] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } } peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } }
I20260807 22:48:01.779980 20466 raft_consensus.cc:374] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:01.780023 20466 raft_consensus.cc:729] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac3f5763d42421f9c82fc39a01d991a, State: Initialized, Role: FOLLOWER
I20260807 22:48:01.780135 20466 consensus_queue.cc:260] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } } peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } }
I20260807 22:48:01.780251 20467 raft_consensus.cc:348] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } } peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } }
I20260807 22:48:01.780367 20467 raft_consensus.cc:374] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:01.780402 20467 raft_consensus.cc:729] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdd31fe8f1934b1e88d94741df87b368, State: Initialized, Role: FOLLOWER
I20260807 22:48:01.780484 20466 ts_tablet_manager.cc:1428] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:48:01.780553 20467 consensus_queue.cc:260] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } } peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } }
I20260807 22:48:01.781282 20467 ts_tablet_manager.cc:1428] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:48:01.781316 20444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.781066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.194:35597)
0807 22:48:01.781188 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.781243 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 22:48:01.782238 20445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.782008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.195:41911)
0807 22:48:01.782121 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.782174 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 22:48:01.783164 20445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.782928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.195:36681)
0807 22:48:01.783061 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.783106 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 22:48:01.784101 20444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.783883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.194:37981)
0807 22:48:01.783986 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.784037 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 22:48:01.784898 20358 heartbeater.cc:503] Master 127.12.112.252:40587 was elected leader, sending a full tablet report...
I20260807 22:48:01.785117 20216 heartbeater.cc:503] Master 127.12.112.252:40587 was elected leader, sending a full tablet report...
I20260807 22:48:01.787485 20465 tablet_bootstrap.cc:492] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683: No bootstrap required, opened a new log
I20260807 22:48:01.787564 20465 ts_tablet_manager.cc:1397] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260807 22:48:01.787976 20465 raft_consensus.cc:348] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } } peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } }
I20260807 22:48:01.788069 20465 raft_consensus.cc:374] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:01.788090 20465 raft_consensus.cc:729] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7ff18bd59840aaac2fd2fed2d15683, State: Initialized, Role: FOLLOWER
I20260807 22:48:01.788264 20465 consensus_queue.cc:260] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } } peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } }
I20260807 22:48:01.788612 20465 ts_tablet_manager.cc:1428] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:48:01.789541 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.789281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.193:38121)
0807 22:48:01.789413 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.789472 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 22:48:01.790411 20075 heartbeater.cc:503] Master 127.12.112.252:40587 was elected leader, sending a full tablet report...
I20260807 22:48:01.790551 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:01.790116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.193:43909)
0807 22:48:01.790397 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:01.790446 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215}
W20260807 22:48:01.875258 20361 tablet.cc:2369] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:48:01.919520 20219 tablet.cc:2369] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:48:02.100628 20471 raft_consensus.cc:482] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:48:02.100855 20471 raft_consensus.cc:504] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } } peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } }
I20260807 22:48:02.102129 20471 leader_election.cc:288] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7ff18bd59840aaac2fd2fed2d15683 (127.12.112.193:44951), aac3f5763d42421f9c82fc39a01d991a (127.12.112.194:44085)
I20260807 22:48:02.106040 20445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.102434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:44085 (local address 127.12.112.195:50683)
0807 22:48:02.102560 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.102576 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:02.102697 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:02.102973 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:02.102978 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:02.103011 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:02.103154 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:02.103160 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:02.104131 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:02.104136 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:02.104932 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:02.104941 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:02.105599 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:02.105603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:02.105714 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:02.105737 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:48:02.105827 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:48:02.105898 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":1}
I20260807 22:48:02.106040 20464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.102567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:50683 (local address 127.12.112.194:44085)
0807 22:48:02.102713 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:02.102718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:02.102757 (+ 39us) server_negotiation.cc:407] Connection header received
0807 22:48:02.102820 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:02.102822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:02.102864 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:02.102920 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:02.103328 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:02.104025 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:02.105056 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:02.105471 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:02.105599 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:02.105659 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:02.105843 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 22:48:02.105915 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:48:02.106364 20460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.102505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:55437 (local address 127.12.112.193:44951)
0807 22:48:02.102637 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:02.102641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:02.103248 (+ 607us) server_negotiation.cc:407] Connection header received
0807 22:48:02.103430 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:02.103433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:02.103476 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:02.103547 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:02.103851 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:02.104354 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:02.105395 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:02.105789 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:02.105919 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:02.105965 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:02.106146 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 22:48:02.106217 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:48:02.106393 20474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.102440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44951 (local address 127.12.112.195:55437)
0807 22:48:02.103151 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.103162 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:02.103286 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:02.103585 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:02.103588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:02.103606 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:02.103707 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:02.103713 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:02.104497 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:02.104500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:02.105249 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:02.105271 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:02.105912 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:02.105916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:02.106018 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:02.106036 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 22:48:02.106131 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 22:48:02.106200 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":316,"thread_start_us":163,"threads_started":1}
I20260807 22:48:02.106670 20169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d60b508c1ffd4a05a4c5bc38513a544a" candidate_uuid: "fdd31fe8f1934b1e88d94741df87b368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac3f5763d42421f9c82fc39a01d991a" is_pre_election: true
I20260807 22:48:02.106782 20027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d60b508c1ffd4a05a4c5bc38513a544a" candidate_uuid: "fdd31fe8f1934b1e88d94741df87b368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" is_pre_election: true
I20260807 22:48:02.106985 20027 raft_consensus.cc:2454] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdd31fe8f1934b1e88d94741df87b368 in term 0.
I20260807 22:48:02.106971 20169 raft_consensus.cc:2454] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdd31fe8f1934b1e88d94741df87b368 in term 0.
I20260807 22:48:02.107375 20244 leader_election.cc:302] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7ff18bd59840aaac2fd2fed2d15683, fdd31fe8f1934b1e88d94741df87b368; no voters:
I20260807 22:48:02.107645 20471 raft_consensus.cc:2781] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:48:02.107718 20471 raft_consensus.cc:482] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:48:02.107757 20471 raft_consensus.cc:3037] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:02.108768 20471 raft_consensus.cc:504] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } } peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } }
I20260807 22:48:02.109104 20471 leader_election.cc:288] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [CANDIDATE]: Term 1 election: Requested vote from peers 5d7ff18bd59840aaac2fd2fed2d15683 (127.12.112.193:44951), aac3f5763d42421f9c82fc39a01d991a (127.12.112.194:44085)
I20260807 22:48:02.109437 20027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d60b508c1ffd4a05a4c5bc38513a544a" candidate_uuid: "fdd31fe8f1934b1e88d94741df87b368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7ff18bd59840aaac2fd2fed2d15683"
I20260807 22:48:02.109485 20169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d60b508c1ffd4a05a4c5bc38513a544a" candidate_uuid: "fdd31fe8f1934b1e88d94741df87b368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac3f5763d42421f9c82fc39a01d991a"
I20260807 22:48:02.109568 20027 raft_consensus.cc:3037] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:02.109601 20169 raft_consensus.cc:3037] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:02.110628 20027 raft_consensus.cc:2454] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdd31fe8f1934b1e88d94741df87b368 in term 1.
I20260807 22:48:02.110702 20169 raft_consensus.cc:2454] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdd31fe8f1934b1e88d94741df87b368 in term 1.
I20260807 22:48:02.110920 20244 leader_election.cc:302] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7ff18bd59840aaac2fd2fed2d15683, fdd31fe8f1934b1e88d94741df87b368; no voters:
I20260807 22:48:02.111141 20471 raft_consensus.cc:2781] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:02.111367 20471 raft_consensus.cc:686] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 1 LEADER]: Becoming Leader. State: Replica: fdd31fe8f1934b1e88d94741df87b368, State: Running, Role: LEADER
I20260807 22:48:02.111619 20471 consensus_queue.cc:237] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } } peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } }
I20260807 22:48:02.112109 20474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.111874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.195:60937)
0807 22:48:02.111992 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.112048 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 22:48:02.113883 19891 catalog_manager.cc:5495] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdd31fe8f1934b1e88d94741df87b368 (127.12.112.195). New cstate: current_term: 1 leader_uuid: "fdd31fe8f1934b1e88d94741df87b368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdd31fe8f1934b1e88d94741df87b368" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 } health_report { overall_health: UNKNOWN } } }
I20260807 22:48:02.140600 20462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.136937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38512 (local address 127.12.112.195:44531)
0807 22:48:02.137080 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:02.137085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:02.137101 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:48:02.137243 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:02.137246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:02.137310 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:02.137425 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:48:02.137678 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:02.138208 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:02.139104 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:02.139338 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:02.139471 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:02.139748 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:48:02.140196 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:48:02.140334 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:02.140396 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 22:48:02.140454 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:48:02.143347 20027 raft_consensus.cc:1261] T d60b508c1ffd4a05a4c5bc38513a544a P 5d7ff18bd59840aaac2fd2fed2d15683 [term 1 FOLLOWER]: Refusing update from remote peer fdd31fe8f1934b1e88d94741df87b368: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:02.143653 20169 raft_consensus.cc:1261] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a [term 1 FOLLOWER]: Refusing update from remote peer fdd31fe8f1934b1e88d94741df87b368: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:02.143944 20471 consensus_queue.cc:1035] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7ff18bd59840aaac2fd2fed2d15683" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:02.144250 20475 consensus_queue.cc:1035] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac3f5763d42421f9c82fc39a01d991a" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:02.146468 20444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.146132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.194:54635)
0807 22:48:02.146326 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.146388 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260807 22:48:02.146716 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.146361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.193:42283)
0807 22:48:02.146590 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.146645 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
I20260807 22:48:02.148710 20474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.148289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.195:33797)
0807 22:48:02.148566 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.148622 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210}
I20260807 22:48:02.149930 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.149636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.193:47473)
0807 22:48:02.149819 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.149866 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260807 22:48:02.155238 20444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.154896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.194:60957)
0807 22:48:02.155110 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.155165 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260807 22:48:02.156288 20474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.156055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:37679 (local address 127.12.112.195:39973)
0807 22:48:02.156167 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.156221 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 22:48:02.161098 19891 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:02.161260 19891 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:02.170562 19891 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 418d1a8f2b094800965c4127658a6804: Sending DeleteTablet for 3 replicas of tablet d60b508c1ffd4a05a4c5bc38513a544a
I20260807 22:48:02.171255 20006 tablet_service.cc:1514] Processing DeleteTablet for tablet d60b508c1ffd4a05a4c5bc38513a544a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:02 UTC) from {username='oryx', principal='oryx/127.12.112.252@KRBTEST.COM'} at 127.0.0.1:36954
I20260807 22:48:02.171401 20148 tablet_service.cc:1514] Processing DeleteTablet for tablet d60b508c1ffd4a05a4c5bc38513a544a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:02 UTC) from {username='oryx', principal='oryx/127.12.112.252@KRBTEST.COM'} at 127.0.0.1:59630
I20260807 22:48:02.171687 20290 tablet_service.cc:1514] Processing DeleteTablet for tablet d60b508c1ffd4a05a4c5bc38513a544a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:02 UTC) from {username='oryx', principal='oryx/127.12.112.252@KRBTEST.COM'} at 127.0.0.1:38496
I20260807 22:48:02.171810 20490 tablet_replica.cc:330] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a: stopping tablet replica
I20260807 22:48:02.171947 20490 raft_consensus.cc:2229] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:48:02.172094 20490 raft_consensus.cc:2258] T d60b508c1ffd4a05a4c5bc38513a544a P aac3f5763d42421f9c82fc39a01d991a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:02.172254 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 19848
I20260807 22:48:02.174495 20491 tablet_replica.cc:330] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: stopping tablet replica
I20260807 22:48:02.174662 20491 raft_consensus.cc:2229] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:48:02.175029 20491 raft_consensus.cc:2258] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:02.175760 20491 ts_tablet_manager.cc:1905] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:02.178447 20491 ts_tablet_manager.cc:1918] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:48:02.178588 20491 log.cc:1196] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/d60b508c1ffd4a05a4c5bc38513a544a
I20260807 22:48:02.178966 20491 ts_tablet_manager.cc:1939] T d60b508c1ffd4a05a4c5bc38513a544a P fdd31fe8f1934b1e88d94741df87b368: Deleting consensus metadata
I20260807 22:48:02.179664 19877 catalog_manager.cc:4841] TS fdd31fe8f1934b1e88d94741df87b368 (127.12.112.195:44531): tablet d60b508c1ffd4a05a4c5bc38513a544a (table test-table [id=9e9cb2366fad416fac65369bd449634d]) successfully deleted
I20260807 22:48:02.182711 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 20083
I20260807 22:48:02.182976 20463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.182666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44951 (local address 127.0.0.1:36968)
0807 22:48:02.182832 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.182885 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260807 22:48:02.185515 19875 catalog_manager.cc:4584] TS 5d7ff18bd59840aaac2fd2fed2d15683 (127.12.112.193:44951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d60b508c1ffd4a05a4c5bc38513a544a: Network error: Client connection negotiation failed: client connection to 127.12.112.193:44951: connect: Connection refused (error 111)
I20260807 22:48:02.191824 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 20223
I20260807 22:48:02.192020 20463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:02.191724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:44085 (local address 127.0.0.1:59644)
0807 22:48:02.191832 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:02.191914 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.194:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 22:48:02.198979 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 19554
I20260807 22:48:02.205994 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 19667
2026-08-07T22:48:02Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7282 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:48:02 dist-test-slave-tm1g krb5kdc[20494](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:48:02 dist-test-slave-tm1g krb5kdc[20494](info): set up 2 sockets
Aug 07 22:48:02 dist-test-slave-tm1g krb5kdc[20494](info): commencing operation
krb5kdc: starting...
W20260807 22:48:03.282850 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:48:03 dist-test-slave-tm1g krb5kdc[20494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:48:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:48:03Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.254.keytab.
Entry for principal oryx/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.254.keytab.
I20260807 22:48:03.407516 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:34851
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.254.keytab
--principal=oryx/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:41687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:34851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:03.520581 20509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:03.520823 20509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:03.520895 20509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:03.524824 20509 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:48:03.524874 20509 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 22:48:03.524892 20509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:03.524909 20509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:03.524925 20509 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:48:03.524986 20509 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:48:03.530347 20509 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:41687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:34851
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.254.keytab
--principal=oryx/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:34851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:03.531491 20509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:03.532555 20509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:03.541110 20518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:03.541146 20516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:03.541137 20515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:03.541410 20509 server_base.cc:1034] running on GCE node
I20260807 22:48:03.542016 20509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:03.543202 20509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:03.544399 20509 hybrid_clock.cc:648] HybridClock initialized: now 1786142883544388 us; error 28 us; skew 500 ppm
Aug 07 22:48:03 dist-test-slave-tm1g krb5kdc[20494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142883, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:03.547151 20509 init.cc:377] Logged in from keytab as oryx/127.12.112.254@KRBTEST.COM (short username oryx)
I20260807 22:48:03.547991 20509 webserver.cc:460] Webserver started at http://127.12.112.254:34871/ using document root <none> and password file <none>
I20260807 22:48:03.548539 20509 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:03.548631 20509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:03.548862 20509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:03.550944 20509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f"
format_stamp: "Formatted at 2026-08-07 22:48:03 on dist-test-slave-tm1g"
server_key: "b08d408a82140e3acc99a9f6e2e40a11"
server_key_iv: "2c5e477c6e65931c799d868841cb8329"
server_key_version: "encryptionkey@0"
I20260807 22:48:03.551512 20509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f"
format_stamp: "Formatted at 2026-08-07 22:48:03 on dist-test-slave-tm1g"
server_key: "b08d408a82140e3acc99a9f6e2e40a11"
server_key_iv: "2c5e477c6e65931c799d868841cb8329"
server_key_version: "encryptionkey@0"
I20260807 22:48:03.555195 20509 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:48:03.557440 20525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:03.558624 20509 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:48:03.558758 20509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f"
format_stamp: "Formatted at 2026-08-07 22:48:03 on dist-test-slave-tm1g"
server_key: "b08d408a82140e3acc99a9f6e2e40a11"
server_key_iv: "2c5e477c6e65931c799d868841cb8329"
server_key_version: "encryptionkey@0"
I20260807 22:48:03.558866 20509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:03.577884 20509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:03.581192 20509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:03.581416 20509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:03.589247 20509 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:34851
I20260807 22:48:03.589280 20587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:34851 every 8 connection(s)
I20260807 22:48:03.590160 20509 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:48:03.592862 20588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:03.593431 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 20509
I20260807 22:48:03.593557 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:48:03.593858 12739 external_mini_cluster.cc:1428] Setting key 9aa76aa0a83e2410e6b383dcc8ce203b
I20260807 22:48:03.598904 20588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f: Bootstrap starting.
I20260807 22:48:03.601246 20588 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:03.601984 20588 log.cc:824] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:48:03 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:48:03.604017 20588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f: No bootstrap required, opened a new log
I20260807 22:48:03.607081 20588 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34851 } }
I20260807 22:48:03.607327 20588 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:03.607452 20588 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1b1d6ccaba6485cb198d8d8dc1aef8f, State: Initialized, Role: FOLLOWER
I20260807 22:48:03.607945 20588 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34851 } }
I20260807 22:48:03.608121 20588 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:48:03.608212 20588 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:48:03.608311 20588 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:03.608615 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:03.595326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40562 (local address 127.12.112.254:34851)
0807 22:48:03.595768 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:03.595782 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:03.595817 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:48:03.596459 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:03.596476 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:03.596781 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:03.597125 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:03.597966 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:03.599012 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:03.599909 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:03.600370 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:03.600544 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:03.603271 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:03.603276 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:03.603288 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:03.603314 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:03.605532 (+ 2218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:03.606027 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:03.606031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:03.606036 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:03.606144 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:03.606499 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:03.606502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:03.606503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:03.606873 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:03.607098 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:03.607351 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 22:48:03.607694 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":144,"threads_started":1}
I20260807 22:48:03.609477 20588 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34851 } }
I20260807 22:48:03.609843 20588 leader_election.cc:302] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1b1d6ccaba6485cb198d8d8dc1aef8f; no voters:
I20260807 22:48:03.610212 20588 leader_election.cc:288] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:48:03.610343 20593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:03.610564 20593 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [term 1 LEADER]: Becoming Leader. State: Replica: a1b1d6ccaba6485cb198d8d8dc1aef8f, State: Running, Role: LEADER
I20260807 22:48:03.611244 20593 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34851 } }
I20260807 22:48:03.611552 20588 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:48:03.612470 20593 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1b1d6ccaba6485cb198d8d8dc1aef8f. Latest consensus state: current_term: 1 leader_uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34851 } } }
I20260807 22:48:03.612697 20593 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:03.612941 20594 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1b1d6ccaba6485cb198d8d8dc1aef8f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34851 } } }
I20260807 22:48:03.613058 20594 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f [sys.catalog]: This master's current role is: LEADER
W20260807 22:48:03.616552 20608 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:48:03.616616 20608 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:48:03.616698 20602 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:48:03.617398 20602 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:48:03.622627 20602 catalog_manager.cc:1347] Generated new cluster ID: ca6efeba83e441258b3b140a9ace63f9
I20260807 22:48:03.622700 20602 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:48:03.631079 20602 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:48:03.631969 20602 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:48:03.638337 20602 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f: Generated new TSK 0
I20260807 22:48:03.639084 20602 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab.
Entry for principal oryx/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab.
I20260807 22:48:03.667665 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34851
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab
--principal=oryx/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:41687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:03.782874 20614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:03.783155 20614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:03.783236 20614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:03.787321 20614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:03.787407 20614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:03.787478 20614 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:48:03.787565 20614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:48:03.792807 20614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:41687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab
--principal=oryx/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.112.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:03.793895 20614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:03.795053 20614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:03.805032 20620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:03.805073 20622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:03.805068 20619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:03.805218 20614 server_base.cc:1034] running on GCE node
I20260807 22:48:03.805728 20614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:03.806507 20614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:03.807672 20614 hybrid_clock.cc:648] HybridClock initialized: now 1786142883807661 us; error 26 us; skew 500 ppm
Aug 07 22:48:03 dist-test-slave-tm1g krb5kdc[20494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142883, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:03.810516 20614 init.cc:377] Logged in from keytab as oryx/127.12.112.193@KRBTEST.COM (short username oryx)
I20260807 22:48:03.811501 20614 webserver.cc:460] Webserver started at http://127.12.112.193:42933/ using document root <none> and password file <none>
I20260807 22:48:03.812112 20614 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:03.812183 20614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:03.812445 20614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:03.814759 20614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "4f69208ca0344e2fb0c0434a1fb13fb6"
format_stamp: "Formatted at 2026-08-07 22:48:03 on dist-test-slave-tm1g"
server_key: "28f6c868ae9663717b9c4167bce6b594"
server_key_iv: "f8515a6fc363252b7ce39aadf67da243"
server_key_version: "encryptionkey@0"
I20260807 22:48:03.815333 20614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "4f69208ca0344e2fb0c0434a1fb13fb6"
format_stamp: "Formatted at 2026-08-07 22:48:03 on dist-test-slave-tm1g"
server_key: "28f6c868ae9663717b9c4167bce6b594"
server_key_iv: "f8515a6fc363252b7ce39aadf67da243"
server_key_version: "encryptionkey@0"
I20260807 22:48:03.819190 20614 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:48:03.821689 20629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:03.822942 20614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:48:03.823062 20614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "4f69208ca0344e2fb0c0434a1fb13fb6"
format_stamp: "Formatted at 2026-08-07 22:48:03 on dist-test-slave-tm1g"
server_key: "28f6c868ae9663717b9c4167bce6b594"
server_key_iv: "f8515a6fc363252b7ce39aadf67da243"
server_key_version: "encryptionkey@0"
I20260807 22:48:03.823175 20614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:03.838614 20614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:03.841362 20614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:03.841564 20614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:03.843125 20614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:03.843174 20614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:03.843214 20614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:03.843271 20614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:48:03 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142883, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:48:03.853945 20614 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:44145
I20260807 22:48:03.854028 20748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:44145 every 8 connection(s)
I20260807 22:48:03.855049 20614 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:48:03.857399 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:03.843847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:34629 (local address 127.12.112.254:34851)
0807 22:48:03.844044 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:03.844049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:03.844903 (+ 854us) server_negotiation.cc:407] Connection header received
0807 22:48:03.846084 (+ 1181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:03.846087 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:03.846156 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:03.846264 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:03.847853 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:03.848802 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:03.850695 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:03.850954 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:03.851078 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:03.853683 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:03.853687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:03.853690 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:03.853727 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:03.855446 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:03.856075 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:03.856078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:03.856079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:03.856161 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:03.856468 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:03.856470 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:03.856471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:03.856648 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:03.856727 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:03.857163 (+ 436us) server_negotiation.cc:299] Negotiation successful
0807 22:48:03.857272 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 22:48:03.858245 20638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:03.844277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34851 (local address 127.12.112.193:34629)
0807 22:48:03.844729 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:03.844779 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:03.845800 (+ 1021us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:03.846461 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:03.846469 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:03.847003 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:03.847660 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:03.847678 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:03.848957 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:03.848961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:03.850574 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:03.850585 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:03.851123 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:03.851127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:03.851315 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:03.851938 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:03.851957 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:03.853443 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:03.855617 (+ 2174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:03.855623 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:03.855636 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:03.855959 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:03.856251 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:03.856253 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:03.856254 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:03.856384 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:03.856738 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:03.856743 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:03.856959 (+ 216us) client_negotiation.cc:769] Sending connection context
0807 22:48:03.857112 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 22:48:03.857347 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":136,"threads_started":1}
I20260807 22:48:03.859567 20749 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34851
I20260807 22:48:03.859709 20749 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:03.860267 20749 heartbeater.cc:511] Master 127.12.112.254:34851 requested a full tablet report, sending...
I20260807 22:48:03.861966 20542 ts_manager.cc:194] Registered new tserver with Master: 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145)
I20260807 22:48:03.863241 20542 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:34629
I20260807 22:48:03.864507 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 20614
I20260807 22:48:03.864655 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:48:03.864987 12739 external_mini_cluster.cc:1428] Setting key 02dce24284bc495b51b66b4d96cc9fbe
I20260807 22:48:03.869378 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:03.861918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:51677 (local address 127.12.112.254:34851)
0807 22:48:03.862037 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:03.862044 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:03.862284 (+ 240us) server_negotiation.cc:407] Connection header received
0807 22:48:03.862481 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:03.862485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:03.862534 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:03.862617 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:03.863066 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:03.863644 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:03.864580 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:03.864799 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:03.864915 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:03.866066 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:03.866070 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:03.866073 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:03.866102 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:03.867733 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:03.868152 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:03.868158 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:03.868163 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:03.868258 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:03.868521 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:03.868526 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:03.868529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:03.868763 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:03.868849 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:03.869172 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 22:48:03.869268 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:48:03.869535 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:03.861912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34851 (local address 127.12.112.193:51677)
0807 22:48:03.862193 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:03.862205 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:03.862374 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:03.862633 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:03.862636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:03.862833 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:03.862949 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:03.862958 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:03.863769 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:03.863772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:03.864458 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:03.864467 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:03.864914 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:03.864917 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:03.865009 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:03.865540 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:03.865556 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:03.865932 (+ 376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:03.867850 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:03.867852 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:03.867853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:03.868055 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:03.868351 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:03.868353 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:03.868354 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:03.868429 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:03.868871 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:03.868877 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:03.868989 (+ 112us) client_negotiation.cc:769] Sending connection context
0807 22:48:03.869122 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 22:48:03.869279 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for oryx/127.12.112.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab.
Entry for principal oryx/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab.
I20260807 22:48:03.893947 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34851
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab
--principal=oryx/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:41687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:04.004273 20758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:04.004515 20758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:04.004557 20758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:04.008520 20758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:04.008574 20758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:04.008612 20758 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:48:04.008643 20758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:48:04.013840 20758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:41687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab
--principal=oryx/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.112.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:04.014853 20758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:04.015798 20758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:48:04.025174 20758 server_base.cc:1034] running on GCE node
W20260807 22:48:04.025110 20763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:04.025130 20766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:04.025110 20764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:04.025789 20758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:04.026527 20758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:04.027715 20758 hybrid_clock.cc:648] HybridClock initialized: now 1786142884027700 us; error 25 us; skew 500 ppm
Aug 07 22:48:04 dist-test-slave-tm1g krb5kdc[20494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142884, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:04.030599 20758 init.cc:377] Logged in from keytab as oryx/127.12.112.194@KRBTEST.COM (short username oryx)
I20260807 22:48:04.031505 20758 webserver.cc:460] Webserver started at http://127.12.112.194:33771/ using document root <none> and password file <none>
I20260807 22:48:04.032069 20758 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:04.032161 20758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:04.032394 20758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:04.034498 20758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "344f14188a2a404e9e55a95a5dfee105"
format_stamp: "Formatted at 2026-08-07 22:48:04 on dist-test-slave-tm1g"
server_key: "d9fd211d59d37168141a1c6f052586a6"
server_key_iv: "984a056306118a99549b0bb140afe5b7"
server_key_version: "encryptionkey@0"
I20260807 22:48:04.035076 20758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "344f14188a2a404e9e55a95a5dfee105"
format_stamp: "Formatted at 2026-08-07 22:48:04 on dist-test-slave-tm1g"
server_key: "d9fd211d59d37168141a1c6f052586a6"
server_key_iv: "984a056306118a99549b0bb140afe5b7"
server_key_version: "encryptionkey@0"
I20260807 22:48:04.038764 20758 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:48:04.041136 20773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:04.042284 20758 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:48:04.042495 20758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "344f14188a2a404e9e55a95a5dfee105"
format_stamp: "Formatted at 2026-08-07 22:48:04 on dist-test-slave-tm1g"
server_key: "d9fd211d59d37168141a1c6f052586a6"
server_key_iv: "984a056306118a99549b0bb140afe5b7"
server_key_version: "encryptionkey@0"
I20260807 22:48:04.042605 20758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:04.051757 20758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:04.054471 20758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:04.054658 20758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:04.056090 20758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:04.056167 20758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:04.056236 20758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:04.056281 20758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:48:04 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142884, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:48:04.067392 20758 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:34797
I20260807 22:48:04.068282 20758 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:48:04.069046 20892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:34797 every 8 connection(s)
I20260807 22:48:04.070030 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.056821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:36997 (local address 127.12.112.254:34851)
0807 22:48:04.056993 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.056999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.057835 (+ 836us) server_negotiation.cc:407] Connection header received
0807 22:48:04.058844 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.058847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.058903 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.059009 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:04.060485 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.061107 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.062607 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.062832 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.062945 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.066151 (+ 3206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:04.066154 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:04.066159 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:04.066188 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:04.067901 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.068413 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.068418 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.068420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.068508 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.068935 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.068939 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.068941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.069161 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:04.069267 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.069809 (+ 542us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.069909 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:48:04.070500 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 20758
I20260807 22:48:04.070638 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:48:04.070914 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.057216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34851 (local address 127.12.112.194:36997)
0807 22:48:04.057668 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.057717 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.058636 (+ 919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.059246 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.059253 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.059751 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:04.060342 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.060355 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.061237 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.061241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.062482 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.062507 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.062985 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.062990 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.063191 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.063851 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:04.063867 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:04.065975 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:04.068031 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:04.068038 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:04.068051 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:04.068304 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:04.068604 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:04.068608 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:04.068610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:04.068817 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:04.069285 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:04.069290 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:04.069588 (+ 298us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.069745 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.069974 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":132,"threads_started":1}
I20260807 22:48:04.070955 12739 external_mini_cluster.cc:1428] Setting key f3d70b3773f95b423e3036452f0fac8c
I20260807 22:48:04.072289 20893 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34851
I20260807 22:48:04.072443 20893 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:04.072983 20893 heartbeater.cc:511] Master 127.12.112.254:34851 requested a full tablet report, sending...
I20260807 22:48:04.074064 20542 ts_manager.cc:194] Registered new tserver with Master: 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797)
I20260807 22:48:04.074860 20542 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:36997
I20260807 22:48:04.082165 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.074633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:59803 (local address 127.12.112.254:34851)
0807 22:48:04.074752 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.074759 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.075008 (+ 249us) server_negotiation.cc:407] Connection header received
0807 22:48:04.075193 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.075196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.075238 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.075324 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:04.075819 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.076291 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.077412 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.077611 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.077682 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.078945 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:04.078947 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:04.078949 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:04.078970 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:04.080413 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.080918 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.080921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.080922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.080991 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.081353 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.081356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.081357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.081565 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:04.081653 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.081964 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.082058 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:48:04.082294 20900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.074632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34851 (local address 127.12.112.194:59803)
0807 22:48:04.074912 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.074929 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.075081 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.075361 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.075365 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.075575 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:04.075693 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.075700 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.076425 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.076428 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.077296 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.077309 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.077741 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.077748 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.077874 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.078360 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:04.078379 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:04.078818 (+ 439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:04.080529 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:04.080536 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:04.080541 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:04.080818 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:04.081085 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:04.081091 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:04.081095 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:04.081204 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:04.081682 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:04.081688 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:04.081793 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.081911 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.082079 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":97,"threads_started":1}
WARNING: no policy specified for oryx/127.12.112.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab.
Entry for principal oryx/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab.
I20260807 22:48:04.101388 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34851
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab
--principal=oryx/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:41687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:04.214926 20902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:04.215183 20902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:04.215227 20902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:04.219276 20902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:04.219329 20902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:04.219368 20902 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:48:04.219399 20902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:48:04.224748 20902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:41687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab
--principal=oryx/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.112.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:04.225700 20902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:04.226747 20902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:04.236299 20908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:04.236361 20907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:04.236367 20910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:04.236654 20902 server_base.cc:1034] running on GCE node
I20260807 22:48:04.237064 20902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:04.237711 20902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:04.238905 20902 hybrid_clock.cc:648] HybridClock initialized: now 1786142884238877 us; error 40 us; skew 500 ppm
Aug 07 22:48:04 dist-test-slave-tm1g krb5kdc[20494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142884, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:04.241482 20902 init.cc:377] Logged in from keytab as oryx/127.12.112.195@KRBTEST.COM (short username oryx)
I20260807 22:48:04.242293 20902 webserver.cc:460] Webserver started at http://127.12.112.195:41649/ using document root <none> and password file <none>
I20260807 22:48:04.242899 20902 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:04.242988 20902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:04.243211 20902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:04.245170 20902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "e41fca692d464139a4e0bdcc73e5dd23"
format_stamp: "Formatted at 2026-08-07 22:48:04 on dist-test-slave-tm1g"
server_key: "f07b071eefa793d5daeb6045aa07aaf9"
server_key_iv: "de827fc74f09e8c80631ced340da25fe"
server_key_version: "encryptionkey@0"
I20260807 22:48:04.245849 20902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "e41fca692d464139a4e0bdcc73e5dd23"
format_stamp: "Formatted at 2026-08-07 22:48:04 on dist-test-slave-tm1g"
server_key: "f07b071eefa793d5daeb6045aa07aaf9"
server_key_iv: "de827fc74f09e8c80631ced340da25fe"
server_key_version: "encryptionkey@0"
I20260807 22:48:04.249580 20902 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:48:04.252066 20917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:04.253278 20902 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 22:48:04.253427 20902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "e41fca692d464139a4e0bdcc73e5dd23"
format_stamp: "Formatted at 2026-08-07 22:48:04 on dist-test-slave-tm1g"
server_key: "f07b071eefa793d5daeb6045aa07aaf9"
server_key_iv: "de827fc74f09e8c80631ced340da25fe"
server_key_version: "encryptionkey@0"
I20260807 22:48:04.253542 20902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:04.264523 20902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:04.267235 20902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:04.267436 20902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:04.268787 20902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:04.268860 20902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:04.268941 20902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:04.268988 20902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:48:04 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142884, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:48:04.280001 20902 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:37951
I20260807 22:48:04.280210 21036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:37951 every 8 connection(s)
I20260807 22:48:04.280869 20902 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:48:04.283262 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.269650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:60843 (local address 127.12.112.254:34851)
0807 22:48:04.269778 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.269796 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.270814 (+ 1018us) server_negotiation.cc:407] Connection header received
0807 22:48:04.271920 (+ 1106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.271924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.272005 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.272075 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:04.273823 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.274768 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.276153 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.276589 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.276720 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.279505 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:04.279512 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:04.279518 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:04.279550 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:04.281249 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.281888 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.281891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.281893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.281975 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.282273 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.282276 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.282277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.282541 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:04.282622 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.283042 (+ 420us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.283143 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:48:04.284046 20926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.270153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34851 (local address 127.12.112.195:60843)
0807 22:48:04.270669 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.270710 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.271665 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.272511 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.272523 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.273021 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:04.273646 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.273667 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.274914 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.274919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.276009 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.276027 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.276778 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.276782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.276985 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.277646 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:04.277662 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:04.279324 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:04.281402 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:04.281408 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:04.281421 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:04.281783 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:04.282064 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:04.282066 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:04.282068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:04.282194 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:04.282636 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:04.282640 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:04.282844 (+ 204us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.282995 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.283224 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":170,"threads_started":1}
I20260807 22:48:04.285225 21037 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34851
I20260807 22:48:04.285375 21037 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:04.285900 21037 heartbeater.cc:511] Master 127.12.112.254:34851 requested a full tablet report, sending...
I20260807 22:48:04.287066 20540 ts_manager.cc:194] Registered new tserver with Master: e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195:37951)
I20260807 22:48:04.287667 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 20902
I20260807 22:48:04.287784 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:48:04.287863 20540 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:60843
I20260807 22:48:04.288123 12739 external_mini_cluster.cc:1428] Setting key da512d34c58db9fff0c14a6f802d80d3
I20260807 22:48:04.290237 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:48:04.295493 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.288172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:49067 (local address 127.12.112.254:34851)
0807 22:48:04.288279 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.288284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.288298 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:48:04.288332 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.288335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.288373 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.288453 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:04.288938 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.289594 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.290528 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.290740 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.290823 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.292149 (+ 1326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:04.292152 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:04.292154 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:04.292175 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:04.293854 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.294272 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.294275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.294277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.294419 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.294744 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.294746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.294747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.294912 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:04.294989 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.295295 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.295386 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:48:04.295694 21044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.287475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34851 (local address 127.12.112.195:49067)
0807 22:48:04.287725 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.287742 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.287825 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.288564 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.288566 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.288727 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:04.288819 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.288823 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.289718 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.289721 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.290408 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.290418 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.290856 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.290861 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.290975 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.291457 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:04.291477 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:04.292013 (+ 536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:04.293980 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:04.293982 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:04.293984 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:04.294181 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:04.294530 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:04.294536 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:04.294541 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:04.294649 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:04.295010 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:04.295016 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:04.295127 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.295246 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.295414 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":95,"threads_started":1}
Aug 07 22:48:04 dist-test-slave-tm1g krb5kdc[20494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142884, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:48:04 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:04 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:48:04.316231 20591 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:04.310043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40564 (local address 127.12.112.254:34851)
0807 22:48:04.310178 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.310181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.310193 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:48:04.310227 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.310230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.310265 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.310384 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:04.311100 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.311675 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.312575 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.312819 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.312918 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.316088 (+ 3170us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40564: BlockingRecv error: recv got EOF from 127.0.0.1:40564 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 22:48:04 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142884, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:48:04.325415 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.317507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40578 (local address 127.12.112.254:34851)
0807 22:48:04.317654 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.317658 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.317782 (+ 124us) server_negotiation.cc:407] Connection header received
0807 22:48:04.317923 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.317926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.317971 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.318057 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:04.318699 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.319200 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.320026 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.320262 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.320368 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.322508 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:04.322512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:04.322515 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:04.322544 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:04.323752 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.324174 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.324177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.324181 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.324261 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.324543 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.324547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.324549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.324725 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:04.324865 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.325128 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.325242 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 22:48:04.328281 20540 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:48:04.331735 20540 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:48:04.346256 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.340415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:37951 (local address 127.0.0.1:53744)
0807 22:48:04.340953 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.340967 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.341063 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.341838 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.341840 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.341852 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:04.342091 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.342097 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.343172 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.343178 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.344517 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.344528 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.345635 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.345639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.345812 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.345831 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.345913 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.346079 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":178,"thread_start_us":125,"threads_started":1}
I20260807 22:48:04.346340 21065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.340769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53744 (local address 127.12.112.195:37951)
0807 22:48:04.341387 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.341400 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.341422 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:48:04.341505 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.341513 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.341701 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.341845 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:04.342208 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.343045 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.344650 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.345470 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.345867 (+ 397us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.345999 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.346059 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.346157 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":117,"threads_started":1}
I20260807 22:48:04.346633 21062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.340122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43970 (local address 127.12.112.194:34797)
0807 22:48:04.340489 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.340502 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.341084 (+ 582us) server_negotiation.cc:407] Connection header received
0807 22:48:04.341184 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.341190 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.341415 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.341589 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:04.342214 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.343475 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.344815 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.345390 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.345546 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.345681 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.346343 (+ 662us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.346464 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":118,"threads_started":1}
I20260807 22:48:04.346716 21067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.340931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49822 (local address 127.12.112.193:44145)
0807 22:48:04.341303 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.341317 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.341653 (+ 336us) server_negotiation.cc:407] Connection header received
0807 22:48:04.341732 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.341737 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.341905 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.342044 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:04.342286 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.343475 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.344902 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.345790 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.345919 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.346036 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.346392 (+ 356us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.346496 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":101,"threads_started":1}
I20260807 22:48:04.346256 21061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.339979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:34797 (local address 127.0.0.1:43970)
0807 22:48:04.340746 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.340798 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.340938 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.341808 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.341816 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.341842 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:04.342070 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.342079 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.343606 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.343611 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.344699 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.344706 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.345528 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.345534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.345707 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.345805 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.345913 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.346078 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":62,"thread_start_us":70,"threads_started":1}
I20260807 22:48:04.347117 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.340661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44145 (local address 127.0.0.1:49822)
0807 22:48:04.341467 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.341480 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.341565 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.342024 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.342028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.342046 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:04.342171 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.342178 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.343628 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.343631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.344758 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.344768 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.346099 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.346103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.346186 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.346209 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.346846 (+ 637us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.346927 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":3,"thread_start_us":84,"threads_started":1}
I20260807 22:48:04.349488 20680 tablet_service.cc:1467] Processing CreateTablet for tablet a3fb58a760b1488fafcc08bf7b6416f4 (DEFAULT_TABLE table=test-table [id=196bb28c593f44c6a445b90337456959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:04.349493 20825 tablet_service.cc:1467] Processing CreateTablet for tablet a3fb58a760b1488fafcc08bf7b6416f4 (DEFAULT_TABLE table=test-table [id=196bb28c593f44c6a445b90337456959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:04.349496 20968 tablet_service.cc:1467] Processing CreateTablet for tablet a3fb58a760b1488fafcc08bf7b6416f4 (DEFAULT_TABLE table=test-table [id=196bb28c593f44c6a445b90337456959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:04.350555 20680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3fb58a760b1488fafcc08bf7b6416f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:04.350569 20825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3fb58a760b1488fafcc08bf7b6416f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:04.350574 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3fb58a760b1488fafcc08bf7b6416f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:04.357393 21068 tablet_bootstrap.cc:492] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: Bootstrap starting.
I20260807 22:48:04.358821 21070 tablet_bootstrap.cc:492] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: Bootstrap starting.
I20260807 22:48:04.358956 21069 tablet_bootstrap.cc:492] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: Bootstrap starting.
I20260807 22:48:04.359995 21068 tablet_bootstrap.cc:654] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:04.360857 21070 tablet_bootstrap.cc:654] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:04.360850 21068 log.cc:824] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:04.360857 21069 tablet_bootstrap.cc:654] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:04.361685 21070 log.cc:824] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:04.361685 21069 log.cc:824] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:04.363152 21068 tablet_bootstrap.cc:492] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: No bootstrap required, opened a new log
I20260807 22:48:04.363351 21068 ts_tablet_manager.cc:1397] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:48:04.363588 21070 tablet_bootstrap.cc:492] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: No bootstrap required, opened a new log
I20260807 22:48:04.363668 21069 tablet_bootstrap.cc:492] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: No bootstrap required, opened a new log
I20260807 22:48:04.363773 21070 ts_tablet_manager.cc:1397] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:48:04.363840 21069 ts_tablet_manager.cc:1397] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:48:04.366657 21070 raft_consensus.cc:348] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.366899 21070 raft_consensus.cc:374] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:04.366954 21070 raft_consensus.cc:729] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344f14188a2a404e9e55a95a5dfee105, State: Initialized, Role: FOLLOWER
I20260807 22:48:04.367381 21070 consensus_queue.cc:260] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.367324 21068 raft_consensus.cc:348] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.367580 21068 raft_consensus.cc:374] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:04.367633 21068 raft_consensus.cc:729] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69208ca0344e2fb0c0434a1fb13fb6, State: Initialized, Role: FOLLOWER
I20260807 22:48:04.367560 21069 raft_consensus.cc:348] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.367798 21069 raft_consensus.cc:374] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:04.367869 21069 raft_consensus.cc:729] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e41fca692d464139a4e0bdcc73e5dd23, State: Initialized, Role: FOLLOWER
I20260807 22:48:04.368085 21068 consensus_queue.cc:260] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.368167 20893 heartbeater.cc:503] Master 127.12.112.254:34851 was elected leader, sending a full tablet report...
I20260807 22:48:04.368448 21070 ts_tablet_manager.cc:1428] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:48:04.368221 21069 consensus_queue.cc:260] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.369045 21068 ts_tablet_manager.cc:1428] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:48:04.369356 20749 heartbeater.cc:503] Master 127.12.112.254:34851 was elected leader, sending a full tablet report...
I20260807 22:48:04.369764 21069 ts_tablet_manager.cc:1428] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:48:04.370064 21037 heartbeater.cc:503] Master 127.12.112.254:34851 was elected leader, sending a full tablet report...
I20260807 22:48:04.417937 21076 raft_consensus.cc:482] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:48:04.418185 21076 raft_consensus.cc:504] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.419341 21076 leader_election.cc:288] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797), 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145)
I20260807 22:48:04.423801 21062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.419865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:39405 (local address 127.12.112.194:34797)
0807 22:48:04.420046 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.420052 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.420066 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:48:04.420123 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.420126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.420175 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.420251 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:04.420634 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.421322 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.422640 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.423251 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.423345 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.423386 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.423626 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.423683 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:48:04.423805 20926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.419686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:34797 (local address 127.12.112.195:39405)
0807 22:48:04.419817 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.419830 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.419939 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.420340 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.420346 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.420381 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:04.420526 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.420536 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.421438 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.421446 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.422515 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.422525 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.423365 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.423368 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.423486 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.423521 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.423600 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.423672 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 22:48:04.424513 21077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.419982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44145 (local address 127.12.112.195:40857)
0807 22:48:04.420375 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.420388 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.420478 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.420744 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.420747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.420764 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:04.420891 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.420898 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.421678 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.421681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.423104 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.423114 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.424094 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.424097 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.424208 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.424230 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.424312 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.424372 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":150,"threads_started":1}
I20260807 22:48:04.424449 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3fb58a760b1488fafcc08bf7b6416f4" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344f14188a2a404e9e55a95a5dfee105" is_pre_election: true
I20260807 22:48:04.424532 21067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.420133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:40857 (local address 127.12.112.193:44145)
0807 22:48:04.420271 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.420275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.420475 (+ 200us) server_negotiation.cc:407] Connection header received
0807 22:48:04.420555 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.420561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.420622 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.420700 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:04.421008 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.421565 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.423232 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.423819 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.423946 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.424019 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.424377 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.424444 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:48:04.424782 20845 raft_consensus.cc:2454] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 0.
I20260807 22:48:04.425135 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3fb58a760b1488fafcc08bf7b6416f4" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" is_pre_election: true
I20260807 22:48:04.425367 20918 leader_election.cc:302] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344f14188a2a404e9e55a95a5dfee105, e41fca692d464139a4e0bdcc73e5dd23; no voters:
I20260807 22:48:04.425402 20701 raft_consensus.cc:2454] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 0.
I20260807 22:48:04.425662 21076 raft_consensus.cc:2781] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:48:04.425776 21076 raft_consensus.cc:482] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:48:04.425838 21076 raft_consensus.cc:3037] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:04.427037 21076 raft_consensus.cc:504] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.427417 21076 leader_election.cc:288] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 election: Requested vote from peers 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797), 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145)
I20260807 22:48:04.427781 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3fb58a760b1488fafcc08bf7b6416f4" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344f14188a2a404e9e55a95a5dfee105"
I20260807 22:48:04.427829 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3fb58a760b1488fafcc08bf7b6416f4" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6"
I20260807 22:48:04.427894 20845 raft_consensus.cc:3037] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:04.427994 20701 raft_consensus.cc:3037] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:04.428965 20845 raft_consensus.cc:2454] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 1.
I20260807 22:48:04.429019 20701 raft_consensus.cc:2454] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 1.
I20260807 22:48:04.429325 20918 leader_election.cc:302] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344f14188a2a404e9e55a95a5dfee105, e41fca692d464139a4e0bdcc73e5dd23; no voters:
I20260807 22:48:04.429548 21076 raft_consensus.cc:2781] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:04.429783 21076 raft_consensus.cc:686] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 1 LEADER]: Becoming Leader. State: Replica: e41fca692d464139a4e0bdcc73e5dd23, State: Running, Role: LEADER
I20260807 22:48:04.430100 21076 consensus_queue.cc:237] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.433218 20540 catalog_manager.cc:5495] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 reported cstate change: term changed from 0 to 1, leader changed from <none> to e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195). New cstate: current_term: 1 leader_uuid: "e41fca692d464139a4e0bdcc73e5dd23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } health_report { overall_health: HEALTHY } } }
I20260807 22:48:04.467764 21065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.464114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53754 (local address 127.12.112.195:37951)
0807 22:48:04.464264 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.464269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.464285 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:48:04.464389 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.464391 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.464445 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.464561 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:48:04.464833 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.465373 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.466244 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.466517 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.466635 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.466933 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:48:04.467362 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:48:04.467494 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.467559 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.467618 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:48:04.473482 20701 raft_consensus.cc:1261] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Refusing update from remote peer e41fca692d464139a4e0bdcc73e5dd23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:04.473914 20845 raft_consensus.cc:1261] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Refusing update from remote peer e41fca692d464139a4e0bdcc73e5dd23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:04.474215 21076 consensus_queue.cc:1035] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:04.474541 21078 consensus_queue.cc:1035] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:04.480808 21081 mvcc.cc:205] Tried to move back new op lower bound from 7316041254796152832 to 7316041254628343808. Current Snapshot: MvccSnapshot[applied={T|T < 7316041254796152832}]
I20260807 22:48:04.491083 20540 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:04.491283 20540 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:04.493726 20540 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f: Sending DeleteTablet for 3 replicas of tablet a3fb58a760b1488fafcc08bf7b6416f4
I20260807 22:48:04.494611 20825 tablet_service.cc:1514] Processing DeleteTablet for tablet a3fb58a760b1488fafcc08bf7b6416f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:04 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:43970
I20260807 22:48:04.494773 20680 tablet_service.cc:1514] Processing DeleteTablet for tablet a3fb58a760b1488fafcc08bf7b6416f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:04 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:49822
I20260807 22:48:04.495112 20968 tablet_service.cc:1514] Processing DeleteTablet for tablet a3fb58a760b1488fafcc08bf7b6416f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:04 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:53744
I20260807 22:48:04.495535 21091 tablet_replica.cc:330] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: stopping tablet replica
I20260807 22:48:04.495571 21093 tablet_replica.cc:330] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: stopping tablet replica
I20260807 22:48:04.495707 20540 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 22:48:04.495857 21093 raft_consensus.cc:2229] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:48:04.495858 21091 raft_consensus.cc:2229] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 22:48:04.496104 20540 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:48:04.496165 21091 raft_consensus.cc:2258] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:04.496199 21093 raft_consensus.cc:2258] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:04.497900 21091 ts_tablet_manager.cc:1905] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:04.500797 21091 ts_tablet_manager.cc:1918] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:48:04.500898 21091 log.cc:1196] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/a3fb58a760b1488fafcc08bf7b6416f4
I20260807 22:48:04.501235 21091 ts_tablet_manager.cc:1939] T a3fb58a760b1488fafcc08bf7b6416f4 P 344f14188a2a404e9e55a95a5dfee105: Deleting consensus metadata
I20260807 22:48:04.502508 20526 catalog_manager.cc:4841] TS 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797): tablet a3fb58a760b1488fafcc08bf7b6416f4 (table test-table [id=196bb28c593f44c6a445b90337456959]) successfully deleted
I20260807 22:48:04.502599 21093 ts_tablet_manager.cc:1905] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:04.502650 21092 tablet_replica.cc:330] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: stopping tablet replica
I20260807 22:48:04.502960 21092 raft_consensus.cc:2229] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:48:04.503063 20680 tablet_service.cc:1467] Processing CreateTablet for tablet 48f1677d42cb4640b8eadc3e1ffe94ad (DEFAULT_TABLE table=test-table [id=0db535f7ed2140afa271026517b1cd7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:04.503273 21092 raft_consensus.cc:2258] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:04.503314 20680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48f1677d42cb4640b8eadc3e1ffe94ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:04.505331 21068 tablet_bootstrap.cc:492] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: Bootstrap starting.
I20260807 22:48:04.505792 21093 ts_tablet_manager.cc:1918] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:48:04.505887 21093 log.cc:1196] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/a3fb58a760b1488fafcc08bf7b6416f4
I20260807 22:48:04.506184 21093 ts_tablet_manager.cc:1939] T a3fb58a760b1488fafcc08bf7b6416f4 P e41fca692d464139a4e0bdcc73e5dd23: Deleting consensus metadata
I20260807 22:48:04.506364 21068 tablet_bootstrap.cc:654] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:04.506733 20968 tablet_service.cc:1467] Processing CreateTablet for tablet 48f1677d42cb4640b8eadc3e1ffe94ad (DEFAULT_TABLE table=test-table [id=0db535f7ed2140afa271026517b1cd7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:04.506994 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48f1677d42cb4640b8eadc3e1ffe94ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:04.507252 20528 catalog_manager.cc:4841] TS e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195:37951): tablet a3fb58a760b1488fafcc08bf7b6416f4 (table test-table [id=196bb28c593f44c6a445b90337456959]) successfully deleted
I20260807 22:48:04.508419 21092 ts_tablet_manager.cc:1905] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:04.509262 21069 tablet_bootstrap.cc:492] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: Bootstrap starting.
I20260807 22:48:04.509955 20825 tablet_service.cc:1467] Processing CreateTablet for tablet 48f1677d42cb4640b8eadc3e1ffe94ad (DEFAULT_TABLE table=test-table [id=0db535f7ed2140afa271026517b1cd7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:04.510190 21069 tablet_bootstrap.cc:654] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:04.510219 20825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48f1677d42cb4640b8eadc3e1ffe94ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:04.510955 21092 ts_tablet_manager.cc:1918] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:48:04.511034 21092 log.cc:1196] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/a3fb58a760b1488fafcc08bf7b6416f4
I20260807 22:48:04.511404 21092 ts_tablet_manager.cc:1939] T a3fb58a760b1488fafcc08bf7b6416f4 P 4f69208ca0344e2fb0c0434a1fb13fb6: Deleting consensus metadata
I20260807 22:48:04.512115 21069 tablet_bootstrap.cc:492] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: No bootstrap required, opened a new log
I20260807 22:48:04.512185 21069 ts_tablet_manager.cc:1397] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260807 22:48:04.512660 21069 raft_consensus.cc:348] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.512769 21069 raft_consensus.cc:374] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:04.512800 21069 raft_consensus.cc:729] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e41fca692d464139a4e0bdcc73e5dd23, State: Initialized, Role: FOLLOWER
I20260807 22:48:04.512809 21070 tablet_bootstrap.cc:492] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: Bootstrap starting.
I20260807 22:48:04.512916 21069 consensus_queue.cc:260] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.513181 21069 ts_tablet_manager.cc:1428] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:48:04.513370 21068 tablet_bootstrap.cc:492] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: No bootstrap required, opened a new log
I20260807 22:48:04.513453 21068 ts_tablet_manager.cc:1397] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260807 22:48:04.513803 21070 tablet_bootstrap.cc:654] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:04.514201 21068 raft_consensus.cc:348] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.514338 21068 raft_consensus.cc:374] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:04.514384 21068 raft_consensus.cc:729] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69208ca0344e2fb0c0434a1fb13fb6, State: Initialized, Role: FOLLOWER
I20260807 22:48:04.514513 21068 consensus_queue.cc:260] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.514609 20526 catalog_manager.cc:4841] TS 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145): tablet a3fb58a760b1488fafcc08bf7b6416f4 (table test-table [id=196bb28c593f44c6a445b90337456959]) successfully deleted
I20260807 22:48:04.514778 21068 ts_tablet_manager.cc:1428] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260807 22:48:04.515792 21070 tablet_bootstrap.cc:492] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: No bootstrap required, opened a new log
I20260807 22:48:04.515888 21070 ts_tablet_manager.cc:1397] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:48:04.516316 21070 raft_consensus.cc:348] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.516425 21070 raft_consensus.cc:374] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:04.516459 21070 raft_consensus.cc:729] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344f14188a2a404e9e55a95a5dfee105, State: Initialized, Role: FOLLOWER
I20260807 22:48:04.516578 21070 consensus_queue.cc:260] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.516813 21070 ts_tablet_manager.cc:1428] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260807 22:48:04.531860 21039 tablet.cc:2369] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:48:04.569690 20894 tablet.cc:2369] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:48:04.606536 20750 tablet.cc:2369] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:48:04.677410 21075 raft_consensus.cc:482] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:48:04.677577 21075 raft_consensus.cc:504] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.678826 21075 leader_election.cc:288] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797), e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195:37951)
I20260807 22:48:04.684221 21065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.679236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:34961 (local address 127.12.112.195:37951)
0807 22:48:04.679375 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.679381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.679622 (+ 241us) server_negotiation.cc:407] Connection header received
0807 22:48:04.679679 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.679681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.679729 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.679806 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:04.680221 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.681020 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.682869 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.683480 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.683607 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.683660 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.684012 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.684086 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:48:04.684221 21062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.679136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:57403 (local address 127.12.112.194:34797)
0807 22:48:04.679284 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.679289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.679481 (+ 192us) server_negotiation.cc:407] Connection header received
0807 22:48:04.679653 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.679657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.679711 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.679806 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:04.680221 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.681014 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.682869 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.683480 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.683607 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.683660 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.684009 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.684086 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 22:48:04.684283 21098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.679144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:37951 (local address 127.12.112.193:34961)
0807 22:48:04.679476 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.679487 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.679576 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.679845 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.679848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.679895 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:04.680095 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.680103 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.681138 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.681141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.682739 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.682750 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.683645 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.683649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.683851 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.683887 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.683969 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.684084 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":344,"spinlock_wait_cycles":43008,"thread_start_us":116,"threads_started":1}
I20260807 22:48:04.684283 21097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.679041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:34797 (local address 127.12.112.193:57403)
0807 22:48:04.679376 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.679391 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.679520 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.679845 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.679848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.679896 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:04.680095 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.680103 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.681138 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.681142 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.682739 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.682750 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.683645 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.683649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.683830 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.683894 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.683969 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.684081 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":201,"spinlock_wait_cycles":5504,"thread_start_us":93,"threads_started":1}
I20260807 22:48:04.684805 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48f1677d42cb4640b8eadc3e1ffe94ad" candidate_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344f14188a2a404e9e55a95a5dfee105" is_pre_election: true
I20260807 22:48:04.684886 20989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48f1677d42cb4640b8eadc3e1ffe94ad" candidate_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e41fca692d464139a4e0bdcc73e5dd23" is_pre_election: true
I20260807 22:48:04.684943 20845 raft_consensus.cc:2454] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69208ca0344e2fb0c0434a1fb13fb6 in term 0.
I20260807 22:48:04.685128 20989 raft_consensus.cc:2454] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69208ca0344e2fb0c0434a1fb13fb6 in term 0.
I20260807 22:48:04.685390 20630 leader_election.cc:302] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344f14188a2a404e9e55a95a5dfee105, 4f69208ca0344e2fb0c0434a1fb13fb6; no voters:
I20260807 22:48:04.685675 21075 raft_consensus.cc:2781] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:48:04.685734 21075 raft_consensus.cc:482] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:48:04.685761 21075 raft_consensus.cc:3037] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:04.686931 21075 raft_consensus.cc:504] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.687314 21075 leader_election.cc:288] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [CANDIDATE]: Term 1 election: Requested vote from peers 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797), e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195:37951)
I20260807 22:48:04.687651 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48f1677d42cb4640b8eadc3e1ffe94ad" candidate_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344f14188a2a404e9e55a95a5dfee105"
I20260807 22:48:04.687669 20989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48f1677d42cb4640b8eadc3e1ffe94ad" candidate_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e41fca692d464139a4e0bdcc73e5dd23"
I20260807 22:48:04.687759 20845 raft_consensus.cc:3037] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:04.687789 20989 raft_consensus.cc:3037] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:04.688723 20845 raft_consensus.cc:2454] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69208ca0344e2fb0c0434a1fb13fb6 in term 1.
I20260807 22:48:04.688822 20989 raft_consensus.cc:2454] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69208ca0344e2fb0c0434a1fb13fb6 in term 1.
I20260807 22:48:04.689054 20630 leader_election.cc:302] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344f14188a2a404e9e55a95a5dfee105, 4f69208ca0344e2fb0c0434a1fb13fb6; no voters:
I20260807 22:48:04.689253 21075 raft_consensus.cc:2781] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:04.689503 21075 raft_consensus.cc:686] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69208ca0344e2fb0c0434a1fb13fb6, State: Running, Role: LEADER
I20260807 22:48:04.689771 21075 consensus_queue.cc:237] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.692178 20540 catalog_manager.cc:5495] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193). New cstate: current_term: 1 leader_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } health_report { overall_health: UNKNOWN } } }
Aug 07 22:48:04 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142883, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.254@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:48:04.780544 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.772230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40594 (local address 127.12.112.254:34851)
0807 22:48:04.772397 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:04.772408 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:04.772620 (+ 212us) server_negotiation.cc:407] Connection header received
0807 22:48:04.772741 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:04.772744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:04.772797 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:04.772866 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:04.773585 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.774131 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.774940 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.775153 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.775234 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.777468 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:04.777471 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:04.777473 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:04.777497 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:04.778770 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.779236 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.779242 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.779244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.779323 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:04.779644 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:04.779648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:04.779650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:04.779820 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:04.779931 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:04.780218 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 22:48:04.780383 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":55}
I20260807 22:48:04.780545 21106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:04.772208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34851 (local address 127.0.0.1:40594)
0807 22:48:04.772534 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:04.772546 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:04.772648 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:04.772906 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:04.772908 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:04.773303 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:04.773450 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.773460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.774227 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.774229 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.774839 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:04.774848 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:04.775251 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:04.775254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:04.775318 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:04.775864 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:04.775876 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:04.777324 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:04.778881 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:04.778893 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:04.778899 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:04.779136 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:04.779432 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:04.779434 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:04.779436 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:04.779534 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:04.779930 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:04.779938 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:04.780053 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 22:48:04.780172 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 22:48:04.780328 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":129,"threads_started":1}
I20260807 22:48:04.784492 20540 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:40594:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 22:48:04.785192 20540 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:48:04.789951 20680 tablet_service.cc:1467] Processing CreateTablet for tablet 2b80366c253f4755bbd2ad1115d1731d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5052180039674411925817f0dc78bf2d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:48:04.790033 20968 tablet_service.cc:1467] Processing CreateTablet for tablet 2b80366c253f4755bbd2ad1115d1731d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5052180039674411925817f0dc78bf2d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:48:04.790033 20825 tablet_service.cc:1467] Processing CreateTablet for tablet 2b80366c253f4755bbd2ad1115d1731d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5052180039674411925817f0dc78bf2d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:48:04.790437 20680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b80366c253f4755bbd2ad1115d1731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:04.790455 20825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b80366c253f4755bbd2ad1115d1731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:04.790455 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b80366c253f4755bbd2ad1115d1731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:04.792848 21068 tablet_bootstrap.cc:492] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: Bootstrap starting.
I20260807 22:48:04.793538 21070 tablet_bootstrap.cc:492] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: Bootstrap starting.
I20260807 22:48:04.793792 21069 tablet_bootstrap.cc:492] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: Bootstrap starting.
I20260807 22:48:04.793926 21068 tablet_bootstrap.cc:654] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:04.794628 21070 tablet_bootstrap.cc:654] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:04.794755 21069 tablet_bootstrap.cc:654] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:04.795465 21068 tablet_bootstrap.cc:492] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: No bootstrap required, opened a new log
I20260807 22:48:04.795570 21068 ts_tablet_manager.cc:1397] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260807 22:48:04.796083 21068 raft_consensus.cc:348] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.796237 21068 raft_consensus.cc:374] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:04.796273 21068 raft_consensus.cc:729] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69208ca0344e2fb0c0434a1fb13fb6, State: Initialized, Role: FOLLOWER
I20260807 22:48:04.796399 21068 consensus_queue.cc:260] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.796469 21069 tablet_bootstrap.cc:492] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: No bootstrap required, opened a new log
I20260807 22:48:04.796543 21069 ts_tablet_manager.cc:1397] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 22:48:04.796556 21070 tablet_bootstrap.cc:492] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: No bootstrap required, opened a new log
I20260807 22:48:04.796638 21070 ts_tablet_manager.cc:1397] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:48:04.796685 21068 ts_tablet_manager.cc:1428] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:48:04.796670 21075 tablet_replica.cc:439] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } } }
I20260807 22:48:04.796836 21075 tablet_replica.cc:442] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:48:04.796953 21069 raft_consensus.cc:348] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.797045 21069 raft_consensus.cc:374] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:04.797067 21069 raft_consensus.cc:729] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e41fca692d464139a4e0bdcc73e5dd23, State: Initialized, Role: FOLLOWER
I20260807 22:48:04.797087 21070 raft_consensus.cc:348] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.797189 21070 raft_consensus.cc:374] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:04.797219 21070 raft_consensus.cc:729] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344f14188a2a404e9e55a95a5dfee105, State: Initialized, Role: FOLLOWER
I20260807 22:48:04.797197 21069 consensus_queue.cc:260] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.797485 21069 ts_tablet_manager.cc:1428] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:48:04.797463 21070 consensus_queue.cc:260] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:04.797570 21088 tablet_replica.cc:439] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } } }
I20260807 22:48:04.797699 21088 tablet_replica.cc:442] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:48:04.797785 21070 ts_tablet_manager.cc:1428] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:48:04.797726 21074 tablet_replica.cc:439] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } } }
I20260807 22:48:04.797880 21074 tablet_replica.cc:442] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:48:05.164723 21075 consensus_queue.cc:1035] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:05.169216 21112 consensus_queue.cc:1035] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:05.193418 21112 raft_consensus.cc:482] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:48:05.193567 21112 raft_consensus.cc:504] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.194042 21112 leader_election.cc:288] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797), e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195:37951)
I20260807 22:48:05.194540 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b80366c253f4755bbd2ad1115d1731d" candidate_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344f14188a2a404e9e55a95a5dfee105" is_pre_election: true
I20260807 22:48:05.194540 20989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b80366c253f4755bbd2ad1115d1731d" candidate_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e41fca692d464139a4e0bdcc73e5dd23" is_pre_election: true
I20260807 22:48:05.194710 20989 raft_consensus.cc:2454] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69208ca0344e2fb0c0434a1fb13fb6 in term 0.
I20260807 22:48:05.194710 20845 raft_consensus.cc:2454] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69208ca0344e2fb0c0434a1fb13fb6 in term 0.
I20260807 22:48:05.195024 20630 leader_election.cc:302] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344f14188a2a404e9e55a95a5dfee105, 4f69208ca0344e2fb0c0434a1fb13fb6; no voters:
I20260807 22:48:05.195232 21112 raft_consensus.cc:2781] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:48:05.195302 21112 raft_consensus.cc:482] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:48:05.195343 21112 raft_consensus.cc:3037] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:05.196379 21112 raft_consensus.cc:504] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.196767 21112 leader_election.cc:288] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [CANDIDATE]: Term 1 election: Requested vote from peers 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797), e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195:37951)
I20260807 22:48:05.197091 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b80366c253f4755bbd2ad1115d1731d" candidate_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344f14188a2a404e9e55a95a5dfee105"
I20260807 22:48:05.197204 20845 raft_consensus.cc:3037] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:05.197146 20989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b80366c253f4755bbd2ad1115d1731d" candidate_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e41fca692d464139a4e0bdcc73e5dd23"
I20260807 22:48:05.197324 20989 raft_consensus.cc:3037] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:05.198177 20845 raft_consensus.cc:2454] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69208ca0344e2fb0c0434a1fb13fb6 in term 1.
I20260807 22:48:05.198413 20989 raft_consensus.cc:2454] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69208ca0344e2fb0c0434a1fb13fb6 in term 1.
I20260807 22:48:05.198474 20630 leader_election.cc:302] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344f14188a2a404e9e55a95a5dfee105, 4f69208ca0344e2fb0c0434a1fb13fb6; no voters:
I20260807 22:48:05.198701 21112 raft_consensus.cc:2781] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:05.198825 21112 raft_consensus.cc:686] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69208ca0344e2fb0c0434a1fb13fb6, State: Running, Role: LEADER
I20260807 22:48:05.198972 21112 consensus_queue.cc:237] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.199735 21075 tablet_replica.cc:439] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: TxnStatusTablet state changed. Reason: New leader 4f69208ca0344e2fb0c0434a1fb13fb6. Latest consensus state: current_term: 1 leader_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } } }
I20260807 22:48:05.199851 21075 tablet_replica.cc:442] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:48:05.200075 21117 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 22:48:05.200256 21117 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 22:48:05.200837 20540 catalog_manager.cc:5495] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193). New cstate: current_term: 1 leader_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } health_report { overall_health: UNKNOWN } } }
I20260807 22:48:05.250444 21106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.246283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44145 (local address 127.0.0.1:49834)
0807 22:48:05.246488 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:05.246507 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:05.246629 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:05.247151 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:05.247154 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:05.247161 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:48:05.247279 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:05.247284 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.248110 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.248114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:05.248739 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:05.248747 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.249231 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.249235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:05.249331 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.249382 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:48:05.250087 (+ 705us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:48:05.250105 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 22:48:05.250181 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:48:05.250278 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 22:48:05.250465 21120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.246433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49834 (local address 127.12.112.193:44145)
0807 22:48:05.246822 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:05.246870 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:05.246885 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:48:05.246962 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:05.246964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:05.247019 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:05.247133 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:48:05.247398 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.247994 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.248879 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.249117 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.249229 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.249564 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:48:05.249982 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:48:05.250112 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:05.250202 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 22:48:05.250263 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":85,"threads_started":1}
I20260807 22:48:05.253778 20989 raft_consensus.cc:1261] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Refusing update from remote peer 4f69208ca0344e2fb0c0434a1fb13fb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:05.253778 20845 raft_consensus.cc:1261] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Refusing update from remote peer 4f69208ca0344e2fb0c0434a1fb13fb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:05.254245 21075 consensus_queue.cc:1035] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:05.254467 21112 consensus_queue.cc:1035] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:05.256181 21074 tablet_replica.cc:439] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: TxnStatusTablet state changed. Reason: New leader 4f69208ca0344e2fb0c0434a1fb13fb6. Latest consensus state: current_term: 1 leader_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } } }
I20260807 22:48:05.256300 21074 tablet_replica.cc:442] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:48:05.256242 21088 tablet_replica.cc:439] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: TxnStatusTablet state changed. Reason: New leader 4f69208ca0344e2fb0c0434a1fb13fb6. Latest consensus state: current_term: 1 leader_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } } }
I20260807 22:48:05.256367 21088 tablet_replica.cc:442] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:48:05.258149 21111 mvcc.cc:205] Tried to move back new op lower bound from 7316041257994960896 to 7316041257776574464. Current Snapshot: MvccSnapshot[applied={T|T < 7316041257994960896}]
I20260807 22:48:05.258334 21099 tablet_replica.cc:439] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } } }
I20260807 22:48:05.258471 21099 tablet_replica.cc:442] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:48:05.258603 21099 tablet_replica.cc:439] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } } }
I20260807 22:48:05.258679 21099 tablet_replica.cc:442] T 2b80366c253f4755bbd2ad1115d1731d P 4f69208ca0344e2fb0c0434a1fb13fb6: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:48:05.261490 21113 mvcc.cc:205] Tried to move back new op lower bound from 7316041257994960896 to 7316041257776574464. Current Snapshot: MvccSnapshot[applied={T|T < 7316041257994960896}]
I20260807 22:48:05.261688 21074 tablet_replica.cc:439] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } } }
I20260807 22:48:05.261786 21074 tablet_replica.cc:442] T 2b80366c253f4755bbd2ad1115d1731d P 344f14188a2a404e9e55a95a5dfee105: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:48:05.262878 21088 tablet_replica.cc:439] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } } }
I20260807 22:48:05.262989 21088 tablet_replica.cc:442] T 2b80366c253f4755bbd2ad1115d1731d P e41fca692d464139a4e0bdcc73e5dd23: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:48:05.266776 21120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.262928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49846 (local address 127.12.112.193:44145)
0807 22:48:05.263040 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:05.263045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:05.263258 (+ 213us) server_negotiation.cc:407] Connection header received
0807 22:48:05.263465 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:05.263472 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:05.263525 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:05.263573 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:48:05.263968 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.264636 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.265688 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.265927 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.266039 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.266298 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:48:05.266406 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:48:05.266486 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:05.266577 (+ 91us) server_negotiation.cc:299] Negotiation successful
0807 22:48:05.266627 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:48:05.277927 21120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.273740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:40089 (local address 127.12.112.193:44145)
0807 22:48:05.273855 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:05.273864 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:05.274617 (+ 753us) server_negotiation.cc:407] Connection header received
0807 22:48:05.274737 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:05.274739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:05.274780 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:05.274839 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:48:05.275113 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.275576 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.276803 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.277027 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.277101 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.277472 (+ 371us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:48:05.277536 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:48:05.277600 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:05.277763 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 22:48:05.277811 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:48:05.277974 21130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.273665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44145 (local address 127.12.112.193:40089)
0807 22:48:05.274530 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:05.274546 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:05.274649 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:05.274877 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:05.274880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:05.274894 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:48:05.275012 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:05.275018 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.275679 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.275683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:05.276689 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:05.276699 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.277154 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.277158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:05.277275 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.277326 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:48:05.277631 (+ 305us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:48:05.277638 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:48:05.277705 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 22:48:05.277783 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":103,"threads_started":1}
I20260807 22:48:05.322868 20541 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:05.323028 20541 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:05.325184 20541 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f: Sending DeleteTablet for 3 replicas of tablet 48f1677d42cb4640b8eadc3e1ffe94ad
I20260807 22:48:05.325877 20825 tablet_service.cc:1514] Processing DeleteTablet for tablet 48f1677d42cb4640b8eadc3e1ffe94ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:05 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:43970
I20260807 22:48:05.325914 20968 tablet_service.cc:1514] Processing DeleteTablet for tablet 48f1677d42cb4640b8eadc3e1ffe94ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:05 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:53744
I20260807 22:48:05.326215 20679 tablet_service.cc:1514] Processing DeleteTablet for tablet 48f1677d42cb4640b8eadc3e1ffe94ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:05 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:49822
I20260807 22:48:05.326567 21133 tablet_replica.cc:330] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: stopping tablet replica
I20260807 22:48:05.326575 21134 tablet_replica.cc:330] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: stopping tablet replica
I20260807 22:48:05.326705 21134 raft_consensus.cc:2229] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:48:05.326751 21133 raft_consensus.cc:2229] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:48:05.326961 21133 raft_consensus.cc:2258] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:05.327111 21134 raft_consensus.cc:2258] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:05.327768 21133 ts_tablet_manager.cc:1905] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:05.327802 21134 ts_tablet_manager.cc:1905] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:05.330884 21133 ts_tablet_manager.cc:1918] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:48:05.330884 21134 ts_tablet_manager.cc:1918] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:48:05.330976 21133 log.cc:1196] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/48f1677d42cb4640b8eadc3e1ffe94ad
I20260807 22:48:05.330976 21134 log.cc:1196] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/48f1677d42cb4640b8eadc3e1ffe94ad
I20260807 22:48:05.331300 21133 ts_tablet_manager.cc:1939] T 48f1677d42cb4640b8eadc3e1ffe94ad P 344f14188a2a404e9e55a95a5dfee105: Deleting consensus metadata
I20260807 22:48:05.332131 21132 tablet_replica.cc:330] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: stopping tablet replica
I20260807 22:48:05.332203 20526 catalog_manager.cc:4841] TS 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797): tablet 48f1677d42cb4640b8eadc3e1ffe94ad (table test-table [id=0db535f7ed2140afa271026517b1cd7c]) successfully deleted
I20260807 22:48:05.332288 21132 raft_consensus.cc:2229] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:48:05.332424 21132 raft_consensus.cc:2258] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:05.333022 21134 ts_tablet_manager.cc:1939] T 48f1677d42cb4640b8eadc3e1ffe94ad P 4f69208ca0344e2fb0c0434a1fb13fb6: Deleting consensus metadata
I20260807 22:48:05.333192 21132 ts_tablet_manager.cc:1905] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:05.333730 20526 catalog_manager.cc:4841] TS 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145): tablet 48f1677d42cb4640b8eadc3e1ffe94ad (table test-table [id=0db535f7ed2140afa271026517b1cd7c]) successfully deleted
I20260807 22:48:05.336140 21132 ts_tablet_manager.cc:1918] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:48:05.336248 21132 log.cc:1196] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/48f1677d42cb4640b8eadc3e1ffe94ad
I20260807 22:48:05.336588 21132 ts_tablet_manager.cc:1939] T 48f1677d42cb4640b8eadc3e1ffe94ad P e41fca692d464139a4e0bdcc73e5dd23: Deleting consensus metadata
I20260807 22:48:05.337411 20528 catalog_manager.cc:4841] TS e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195:37951): tablet 48f1677d42cb4640b8eadc3e1ffe94ad (table test-table [id=0db535f7ed2140afa271026517b1cd7c]) successfully deleted
Aug 07 22:48:05 dist-test-slave-tm1g krb5kdc[20494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:48:05 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:05 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:48:05.358064 21143 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:05.351088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40606 (local address 127.12.112.254:34851)
0807 22:48:05.351351 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:05.351356 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:05.351430 (+ 74us) server_negotiation.cc:407] Connection header received
0807 22:48:05.351557 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:05.351561 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:05.351615 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:05.351718 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:05.352435 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.353270 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.354102 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.354510 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.354614 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.357914 (+ 3300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40606: BlockingRecv error: recv got EOF from 127.0.0.1:40606 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":76,"threads_started":1}
Aug 07 22:48:05 dist-test-slave-tm1g krb5kdc[20494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM
I20260807 22:48:05.369513 21143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.359719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40622 (local address 127.12.112.254:34851)
0807 22:48:05.359969 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:05.359974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:05.360206 (+ 232us) server_negotiation.cc:407] Connection header received
0807 22:48:05.360395 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:05.360398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:05.360452 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:05.360535 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:05.361136 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.361951 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.362933 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.363264 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.363407 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.365870 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:05.365873 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:05.365877 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:05.365907 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:05.367861 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:05.368276 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:05.368280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:05.368281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:05.368387 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:05.368657 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:05.368660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:05.368662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:05.368889 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:05.369023 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:05.369208 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 22:48:05.369331 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161}
I20260807 22:48:05.372383 20541 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:48:05.372844 20541 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:48:05.378019 20679 tablet_service.cc:1467] Processing CreateTablet for tablet 8b5e299ada5d41548521d5d042fcc003 (DEFAULT_TABLE table=test-table [id=0932a71db45b430b83dee4b87bb46afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:05.378283 20825 tablet_service.cc:1467] Processing CreateTablet for tablet 8b5e299ada5d41548521d5d042fcc003 (DEFAULT_TABLE table=test-table [id=0932a71db45b430b83dee4b87bb46afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:05.378283 20968 tablet_service.cc:1467] Processing CreateTablet for tablet 8b5e299ada5d41548521d5d042fcc003 (DEFAULT_TABLE table=test-table [id=0932a71db45b430b83dee4b87bb46afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:05.378388 20679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b5e299ada5d41548521d5d042fcc003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:05.378599 20825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b5e299ada5d41548521d5d042fcc003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:05.378599 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b5e299ada5d41548521d5d042fcc003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:05.381294 21151 tablet_bootstrap.cc:492] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6: Bootstrap starting.
I20260807 22:48:05.381309 21149 tablet_bootstrap.cc:492] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105: Bootstrap starting.
I20260807 22:48:05.382161 21151 tablet_bootstrap.cc:654] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:05.382265 21149 tablet_bootstrap.cc:654] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:05.383013 21150 tablet_bootstrap.cc:492] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23: Bootstrap starting.
I20260807 22:48:05.383430 21151 tablet_bootstrap.cc:492] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6: No bootstrap required, opened a new log
I20260807 22:48:05.383523 21151 ts_tablet_manager.cc:1397] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:48:05.383867 21150 tablet_bootstrap.cc:654] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:05.383919 21151 raft_consensus.cc:348] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.384043 21151 raft_consensus.cc:374] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:05.384078 21151 raft_consensus.cc:729] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69208ca0344e2fb0c0434a1fb13fb6, State: Initialized, Role: FOLLOWER
I20260807 22:48:05.384203 21151 consensus_queue.cc:260] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.385015 21151 ts_tablet_manager.cc:1428] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:48:05.385212 21150 tablet_bootstrap.cc:492] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23: No bootstrap required, opened a new log
I20260807 22:48:05.385313 21150 ts_tablet_manager.cc:1397] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:48:05.385813 21150 raft_consensus.cc:348] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.385929 21150 raft_consensus.cc:374] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:05.385975 21150 raft_consensus.cc:729] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e41fca692d464139a4e0bdcc73e5dd23, State: Initialized, Role: FOLLOWER
I20260807 22:48:05.386127 21150 consensus_queue.cc:260] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.386442 21150 ts_tablet_manager.cc:1428] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:48:05.386981 21149 tablet_bootstrap.cc:492] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105: No bootstrap required, opened a new log
I20260807 22:48:05.387079 21149 ts_tablet_manager.cc:1397] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260807 22:48:05.387542 21149 raft_consensus.cc:348] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.387674 21149 raft_consensus.cc:374] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:05.387722 21149 raft_consensus.cc:729] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344f14188a2a404e9e55a95a5dfee105, State: Initialized, Role: FOLLOWER
I20260807 22:48:05.387851 21149 consensus_queue.cc:260] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.388156 21149 ts_tablet_manager.cc:1428] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:48:05.603974 21088 raft_consensus.cc:482] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:48:05.604122 21088 raft_consensus.cc:504] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.604561 21088 leader_election.cc:288] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145), 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797)
I20260807 22:48:05.605106 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b5e299ada5d41548521d5d042fcc003" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344f14188a2a404e9e55a95a5dfee105" is_pre_election: true
I20260807 22:48:05.605106 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b5e299ada5d41548521d5d042fcc003" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" is_pre_election: true
I20260807 22:48:05.605285 20845 raft_consensus.cc:2454] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 0.
I20260807 22:48:05.605283 20701 raft_consensus.cc:2454] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 0.
I20260807 22:48:05.605659 20918 leader_election.cc:302] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344f14188a2a404e9e55a95a5dfee105, e41fca692d464139a4e0bdcc73e5dd23; no voters:
I20260807 22:48:05.605841 21088 raft_consensus.cc:2781] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:48:05.605902 21088 raft_consensus.cc:482] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:48:05.605945 21088 raft_consensus.cc:3037] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:05.607069 21088 raft_consensus.cc:504] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.607399 21088 leader_election.cc:288] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 election: Requested vote from peers 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145), 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797)
I20260807 22:48:05.607776 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b5e299ada5d41548521d5d042fcc003" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6"
I20260807 22:48:05.607782 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b5e299ada5d41548521d5d042fcc003" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344f14188a2a404e9e55a95a5dfee105"
I20260807 22:48:05.607914 20701 raft_consensus.cc:3037] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:05.607935 20845 raft_consensus.cc:3037] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:05.609061 20701 raft_consensus.cc:2454] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 1.
I20260807 22:48:05.609064 20845 raft_consensus.cc:2454] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 1.
I20260807 22:48:05.609376 20918 leader_election.cc:302] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69208ca0344e2fb0c0434a1fb13fb6, e41fca692d464139a4e0bdcc73e5dd23; no voters:
I20260807 22:48:05.609565 21088 raft_consensus.cc:2781] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:05.609773 21088 raft_consensus.cc:686] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 1 LEADER]: Becoming Leader. State: Replica: e41fca692d464139a4e0bdcc73e5dd23, State: Running, Role: LEADER
I20260807 22:48:05.609944 21088 consensus_queue.cc:237] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.611883 20541 catalog_manager.cc:5495] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 reported cstate change: term changed from 0 to 1, leader changed from <none> to e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195). New cstate: current_term: 1 leader_uuid: "e41fca692d464139a4e0bdcc73e5dd23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } health_report { overall_health: HEALTHY } } }
I20260807 22:48:05.622946 21158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.619638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53770 (local address 127.12.112.195:37951)
0807 22:48:05.619908 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:05.619915 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:05.619928 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:48:05.619968 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:05.619970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:05.620021 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:05.620095 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:48:05.620414 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.620932 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.621858 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.622081 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.622166 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.622474 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:48:05.622549 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:48:05.622605 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:05.622717 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 22:48:05.622762 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":110,"threads_started":1}
I20260807 22:48:05.624855 20701 raft_consensus.cc:1261] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Refusing update from remote peer e41fca692d464139a4e0bdcc73e5dd23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:05.624852 20845 raft_consensus.cc:1261] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Refusing update from remote peer e41fca692d464139a4e0bdcc73e5dd23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:05.625378 21155 consensus_queue.cc:1035] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:05.625507 21088 consensus_queue.cc:1035] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:05.634258 20541 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:05.634450 20541 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:05.636245 20541 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f: Sending DeleteTablet for 3 replicas of tablet 8b5e299ada5d41548521d5d042fcc003
I20260807 22:48:05.636780 20679 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b5e299ada5d41548521d5d042fcc003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:05 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:49822
I20260807 22:48:05.636811 20825 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b5e299ada5d41548521d5d042fcc003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:05 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:43970
I20260807 22:48:05.636978 21134 tablet_replica.cc:330] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6: stopping tablet replica
I20260807 22:48:05.636982 20968 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b5e299ada5d41548521d5d042fcc003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:05 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:53744
I20260807 22:48:05.637115 21134 raft_consensus.cc:2229] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:48:05.637144 21132 tablet_replica.cc:330] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23: stopping tablet replica
I20260807 22:48:05.637249 21134 raft_consensus.cc:2258] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:05.637243 21132 raft_consensus.cc:2229] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:48:05.637420 21133 tablet_replica.cc:330] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105: stopping tablet replica
I20260807 22:48:05.637424 21132 raft_consensus.cc:2258] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:05.637554 21133 raft_consensus.cc:2229] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:48:05.637672 21133 raft_consensus.cc:2258] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:05.638362 21133 ts_tablet_manager.cc:1905] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:05.638793 21132 ts_tablet_manager.cc:1905] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:05.641016 21133 ts_tablet_manager.cc:1918] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:48:05.641105 21133 log.cc:1196] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/8b5e299ada5d41548521d5d042fcc003
I20260807 22:48:05.641388 21133 ts_tablet_manager.cc:1939] T 8b5e299ada5d41548521d5d042fcc003 P 344f14188a2a404e9e55a95a5dfee105: Deleting consensus metadata
I20260807 22:48:05.641390 21132 ts_tablet_manager.cc:1918] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:48:05.641458 21132 log.cc:1196] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/8b5e299ada5d41548521d5d042fcc003
I20260807 22:48:05.641701 21132 ts_tablet_manager.cc:1939] T 8b5e299ada5d41548521d5d042fcc003 P e41fca692d464139a4e0bdcc73e5dd23: Deleting consensus metadata
I20260807 22:48:05.642129 20526 catalog_manager.cc:4841] TS 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797): tablet 8b5e299ada5d41548521d5d042fcc003 (table test-table [id=0932a71db45b430b83dee4b87bb46afd]) successfully deleted
I20260807 22:48:05.642391 20528 catalog_manager.cc:4841] TS e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195:37951): tablet 8b5e299ada5d41548521d5d042fcc003 (table test-table [id=0932a71db45b430b83dee4b87bb46afd]) successfully deleted
I20260807 22:48:05.642422 21134 ts_tablet_manager.cc:1905] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:05.642453 20541 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:48:05.642911 20541 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:48:05.644564 21134 ts_tablet_manager.cc:1918] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:48:05.644659 21134 log.cc:1196] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/8b5e299ada5d41548521d5d042fcc003
I20260807 22:48:05.644964 21134 ts_tablet_manager.cc:1939] T 8b5e299ada5d41548521d5d042fcc003 P 4f69208ca0344e2fb0c0434a1fb13fb6: Deleting consensus metadata
I20260807 22:48:05.645980 20526 catalog_manager.cc:4841] TS 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145): tablet 8b5e299ada5d41548521d5d042fcc003 (table test-table [id=0932a71db45b430b83dee4b87bb46afd]) successfully deleted
I20260807 22:48:05.647672 20679 tablet_service.cc:1467] Processing CreateTablet for tablet 8334a3ddc5e640b99d1872eb9f04c58d (DEFAULT_TABLE table=test-table [id=6d84a0e0bc1649d689b40170d4f1d20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:05.647707 20825 tablet_service.cc:1467] Processing CreateTablet for tablet 8334a3ddc5e640b99d1872eb9f04c58d (DEFAULT_TABLE table=test-table [id=6d84a0e0bc1649d689b40170d4f1d20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:05.647995 20679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8334a3ddc5e640b99d1872eb9f04c58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:05.648013 20825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8334a3ddc5e640b99d1872eb9f04c58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:05.649865 21149 tablet_bootstrap.cc:492] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105: Bootstrap starting.
I20260807 22:48:05.649932 21151 tablet_bootstrap.cc:492] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6: Bootstrap starting.
I20260807 22:48:05.650542 20968 tablet_service.cc:1467] Processing CreateTablet for tablet 8334a3ddc5e640b99d1872eb9f04c58d (DEFAULT_TABLE table=test-table [id=6d84a0e0bc1649d689b40170d4f1d20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:05.650779 21151 tablet_bootstrap.cc:654] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:05.650813 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8334a3ddc5e640b99d1872eb9f04c58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:05.651130 21149 tablet_bootstrap.cc:654] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:05.651983 21151 tablet_bootstrap.cc:492] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6: No bootstrap required, opened a new log
I20260807 22:48:05.652077 21151 ts_tablet_manager.cc:1397] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:48:05.652323 21149 tablet_bootstrap.cc:492] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105: No bootstrap required, opened a new log
I20260807 22:48:05.652433 21149 ts_tablet_manager.cc:1397] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 22:48:05.652487 21151 raft_consensus.cc:348] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.652611 21151 raft_consensus.cc:374] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:05.652650 21151 raft_consensus.cc:729] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69208ca0344e2fb0c0434a1fb13fb6, State: Initialized, Role: FOLLOWER
I20260807 22:48:05.652789 21151 consensus_queue.cc:260] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.652935 21149 raft_consensus.cc:348] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.653048 21149 raft_consensus.cc:374] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:05.653083 21149 raft_consensus.cc:729] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344f14188a2a404e9e55a95a5dfee105, State: Initialized, Role: FOLLOWER
I20260807 22:48:05.653085 21151 ts_tablet_manager.cc:1428] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:48:05.653119 21150 tablet_bootstrap.cc:492] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23: Bootstrap starting.
I20260807 22:48:05.653226 21149 consensus_queue.cc:260] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.653586 21149 ts_tablet_manager.cc:1428] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:48:05.653987 21150 tablet_bootstrap.cc:654] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:05.655484 21150 tablet_bootstrap.cc:492] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23: No bootstrap required, opened a new log
I20260807 22:48:05.655589 21150 ts_tablet_manager.cc:1397] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 22:48:05.655972 21150 raft_consensus.cc:348] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.656104 21150 raft_consensus.cc:374] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:05.656145 21150 raft_consensus.cc:729] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e41fca692d464139a4e0bdcc73e5dd23, State: Initialized, Role: FOLLOWER
I20260807 22:48:05.656291 21150 consensus_queue.cc:260] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.656575 21150 ts_tablet_manager.cc:1428] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:48:05.793074 21155 raft_consensus.cc:482] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:48:05.793231 21155 raft_consensus.cc:504] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.793708 21155 leader_election.cc:288] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145), 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797)
I20260807 22:48:05.794344 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8334a3ddc5e640b99d1872eb9f04c58d" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344f14188a2a404e9e55a95a5dfee105" is_pre_election: true
I20260807 22:48:05.794353 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8334a3ddc5e640b99d1872eb9f04c58d" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" is_pre_election: true
I20260807 22:48:05.794526 20701 raft_consensus.cc:2454] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 0.
I20260807 22:48:05.794528 20845 raft_consensus.cc:2454] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 0.
I20260807 22:48:05.794869 20918 leader_election.cc:302] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344f14188a2a404e9e55a95a5dfee105, e41fca692d464139a4e0bdcc73e5dd23; no voters:
I20260807 22:48:05.795085 21155 raft_consensus.cc:2781] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:48:05.795166 21155 raft_consensus.cc:482] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:48:05.795220 21155 raft_consensus.cc:3037] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:05.796247 21155 raft_consensus.cc:504] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.796577 21155 leader_election.cc:288] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 election: Requested vote from peers 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145), 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797)
I20260807 22:48:05.796972 20701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8334a3ddc5e640b99d1872eb9f04c58d" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6"
I20260807 22:48:05.797016 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8334a3ddc5e640b99d1872eb9f04c58d" candidate_uuid: "e41fca692d464139a4e0bdcc73e5dd23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344f14188a2a404e9e55a95a5dfee105"
I20260807 22:48:05.797079 20701 raft_consensus.cc:3037] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:05.797153 20845 raft_consensus.cc:3037] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:05.798048 20845 raft_consensus.cc:2454] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 1.
I20260807 22:48:05.798065 20701 raft_consensus.cc:2454] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e41fca692d464139a4e0bdcc73e5dd23 in term 1.
I20260807 22:48:05.798400 20918 leader_election.cc:302] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69208ca0344e2fb0c0434a1fb13fb6, e41fca692d464139a4e0bdcc73e5dd23; no voters:
I20260807 22:48:05.798590 21155 raft_consensus.cc:2781] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:05.798700 21155 raft_consensus.cc:686] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 1 LEADER]: Becoming Leader. State: Replica: e41fca692d464139a4e0bdcc73e5dd23, State: Running, Role: LEADER
I20260807 22:48:05.798864 21155 consensus_queue.cc:237] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } }
I20260807 22:48:05.800496 20540 catalog_manager.cc:5495] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 reported cstate change: term changed from 0 to 1, leader changed from <none> to e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195). New cstate: current_term: 1 leader_uuid: "e41fca692d464139a4e0bdcc73e5dd23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e41fca692d464139a4e0bdcc73e5dd23" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 37951 } health_report { overall_health: HEALTHY } } }
I20260807 22:48:05.858610 21171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.854738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:37067 (local address 127.12.112.193:44145)
0807 22:48:05.854991 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:05.854995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:05.855053 (+ 58us) server_negotiation.cc:407] Connection header received
0807 22:48:05.855167 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:05.855170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:05.855222 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:05.855317 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:48:05.855534 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.856379 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.857339 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.857624 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.857744 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.858039 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:48:05.858152 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:48:05.858243 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:05.858392 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 22:48:05.858451 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":81,"threads_started":1}
I20260807 22:48:05.858610 21170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.854666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44145 (local address 127.12.112.195:37067)
0807 22:48:05.854959 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:05.854973 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:05.855073 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:05.855332 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:05.855334 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:05.855340 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:48:05.855435 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:05.855439 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.856529 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.856532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:05.857204 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:05.857212 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.857757 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.857760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:05.857846 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.857889 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:48:05.858246 (+ 357us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:48:05.858255 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 22:48:05.858376 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 22:48:05.858468 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":100,"threads_started":1}
I20260807 22:48:05.864463 20845 raft_consensus.cc:1261] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Refusing update from remote peer e41fca692d464139a4e0bdcc73e5dd23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:05.864485 20701 raft_consensus.cc:1261] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Refusing update from remote peer e41fca692d464139a4e0bdcc73e5dd23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:05.864871 21088 consensus_queue.cc:1035] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "344f14188a2a404e9e55a95a5dfee105" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 34797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:05.865041 21155 consensus_queue.cc:1035] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69208ca0344e2fb0c0434a1fb13fb6" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 44145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:05.883733 21158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.880144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:50235 (local address 127.12.112.195:37951)
0807 22:48:05.880284 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:05.880289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:05.880482 (+ 193us) server_negotiation.cc:407] Connection header received
0807 22:48:05.880595 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:05.880598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:05.880643 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:05.880726 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:48:05.880969 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.881486 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.882676 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.882918 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.883029 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.883343 (+ 314us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:48:05.883436 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:48:05.883506 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:05.883587 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 22:48:05.883635 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:48:05.883776 21177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.880079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:37951 (local address 127.12.112.193:50235)
0807 22:48:05.880388 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:05.880403 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:05.880507 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:05.880747 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:05.880750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:05.880759 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:48:05.880860 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:05.880866 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.881683 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.881689 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:05.882564 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:05.882579 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:05.883040 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:05.883044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:05.883132 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:05.883165 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:48:05.883515 (+ 350us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:48:05.883522 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:48:05.883578 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:48:05.883653 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":131,"threads_started":1}
I20260807 22:48:05.901752 20540 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:05.901908 20540 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:05.904024 20540 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a1b1d6ccaba6485cb198d8d8dc1aef8f: Sending DeleteTablet for 3 replicas of tablet 8334a3ddc5e640b99d1872eb9f04c58d
I20260807 22:48:05.904585 20679 tablet_service.cc:1514] Processing DeleteTablet for tablet 8334a3ddc5e640b99d1872eb9f04c58d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:05 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:49822
I20260807 22:48:05.904681 20825 tablet_service.cc:1514] Processing DeleteTablet for tablet 8334a3ddc5e640b99d1872eb9f04c58d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:05 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:43970
I20260807 22:48:05.904819 21134 tablet_replica.cc:330] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6: stopping tablet replica
I20260807 22:48:05.904894 21133 tablet_replica.cc:330] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105: stopping tablet replica
I20260807 22:48:05.904976 21134 raft_consensus.cc:2229] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:48:05.905035 21133 raft_consensus.cc:2229] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:48:05.905086 21134 raft_consensus.cc:2258] T 8334a3ddc5e640b99d1872eb9f04c58d P 4f69208ca0344e2fb0c0434a1fb13fb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:05.905164 21133 raft_consensus.cc:2258] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:05.905478 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 20614
I20260807 22:48:05.905455 20968 tablet_service.cc:1514] Processing DeleteTablet for tablet 8334a3ddc5e640b99d1872eb9f04c58d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:05 UTC) from {username='oryx', principal='oryx/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:53744
I20260807 22:48:05.905648 21132 tablet_replica.cc:330] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23: stopping tablet replica
I20260807 22:48:05.905794 21132 raft_consensus.cc:2229] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:48:05.905982 21132 raft_consensus.cc:2258] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:05.908231 21132 ts_tablet_manager.cc:1905] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:05.908915 21133 ts_tablet_manager.cc:1905] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:05.910764 21132 ts_tablet_manager.cc:1918] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:48:05.910871 21132 log.cc:1196] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/8334a3ddc5e640b99d1872eb9f04c58d
I20260807 22:48:05.911214 21132 ts_tablet_manager.cc:1939] T 8334a3ddc5e640b99d1872eb9f04c58d P e41fca692d464139a4e0bdcc73e5dd23: Deleting consensus metadata
I20260807 22:48:05.911949 20528 catalog_manager.cc:4841] TS e41fca692d464139a4e0bdcc73e5dd23 (127.12.112.195:37951): tablet 8334a3ddc5e640b99d1872eb9f04c58d (table test-table [id=6d84a0e0bc1649d689b40170d4f1d20b]) successfully deleted
I20260807 22:48:05.912344 21133 ts_tablet_manager.cc:1918] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:48:05.912436 21133 log.cc:1196] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/8334a3ddc5e640b99d1872eb9f04c58d
I20260807 22:48:05.912709 21133 ts_tablet_manager.cc:1939] T 8334a3ddc5e640b99d1872eb9f04c58d P 344f14188a2a404e9e55a95a5dfee105: Deleting consensus metadata
I20260807 22:48:05.913513 20526 catalog_manager.cc:4841] TS 344f14188a2a404e9e55a95a5dfee105 (127.12.112.194:34797): tablet 8334a3ddc5e640b99d1872eb9f04c58d (table test-table [id=6d84a0e0bc1649d689b40170d4f1d20b]) successfully deleted
W20260807 22:48:05.917630 20526 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:44145 (error 108)
I20260807 22:48:05.917837 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 20758
I20260807 22:48:05.920115 21180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:05.919567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:44145 (local address 127.0.0.1:49856)
0807 22:48:05.919966 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:05.920028 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":51,"threads_started":1}
W20260807 22:48:05.920251 20526 catalog_manager.cc:4584] TS 4f69208ca0344e2fb0c0434a1fb13fb6 (127.12.112.193:44145): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8334a3ddc5e640b99d1872eb9f04c58d: Network error: Client connection negotiation failed: client connection to 127.12.112.193:44145: connect: Connection refused (error 111)
I20260807 22:48:05.925374 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 20902
I20260807 22:48:05.933423 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 20509
2026-08-07T22:48:05Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3727 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:48:05 dist-test-slave-tm1g krb5kdc[21183](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:48:05 dist-test-slave-tm1g krb5kdc[21183](info): set up 2 sockets
Aug 07 22:48:05 dist-test-slave-tm1g krb5kdc[21183](info): commencing operation
krb5kdc: starting...
W20260807 22:48:07.010905 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:48:07 dist-test-slave-tm1g krb5kdc[21183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:48:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:48:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:48:07.141919 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:35875
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:45863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:35875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:07.271246 21196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:07.271561 21196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:07.271653 21196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:07.275928 21196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:48:07.276041 21196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:07.276081 21196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:07.276142 21196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:48:07.276180 21196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:48:07.281723 21196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:45863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:35875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:35875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:07.282944 21196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:07.284015 21196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:07.292874 21201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:07.292869 21202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:07.292868 21204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:07.293320 21196 server_base.cc:1034] running on GCE node
I20260807 22:48:07.293880 21196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:07.295090 21196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:07.296306 21196 hybrid_clock.cc:648] HybridClock initialized: now 1786142887296286 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T22:48:07Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1374 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:48:07 dist-test-slave-tm1g krb5kdc[21210](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:48:07 dist-test-slave-tm1g krb5kdc[21210](info): set up 2 sockets
Aug 07 22:48:07 dist-test-slave-tm1g krb5kdc[21210](info): commencing operation
krb5kdc: starting...
W20260807 22:48:08.383332 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:48:08 dist-test-slave-tm1g krb5kdc[21210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:48:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:48:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:48:08.510772 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:42577
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:42577
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:08.627142 21223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:08.627425 21223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:08.627468 21223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:08.631536 21223 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:48:08.631603 21223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:08.631623 21223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:08.631640 21223 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:48:08.631655 21223 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:48:08.637027 21223 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:42577
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:42577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:08.638175 21223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:08.639341 21223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:08.648418 21231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:08.648422 21228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:08.648422 21229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:08.648761 21223 server_base.cc:1034] running on GCE node
I20260807 22:48:08.649302 21223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:08.650484 21223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:08.651667 21223 hybrid_clock.cc:648] HybridClock initialized: now 1786142888651646 us; error 50 us; skew 500 ppm
Aug 07 22:48:08 dist-test-slave-tm1g krb5kdc[21210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142888, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:08.654706 21223 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:48:08.655601 21223 webserver.cc:460] Webserver started at http://127.12.112.254:35681/ using document root <none> and password file <none>
I20260807 22:48:08.656169 21223 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:08.656265 21223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:08.656508 21223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:08.658684 21223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "6ed0207a01464a40a235189255069f0e"
format_stamp: "Formatted at 2026-08-07 22:48:08 on dist-test-slave-tm1g"
server_key: "d40e56d37417cdf55cd44accf526552a"
server_key_iv: "0ec696a331d071dd922f1fbb0caabbf4"
server_key_version: "encryptionkey@0"
I20260807 22:48:08.659253 21223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "6ed0207a01464a40a235189255069f0e"
format_stamp: "Formatted at 2026-08-07 22:48:08 on dist-test-slave-tm1g"
server_key: "d40e56d37417cdf55cd44accf526552a"
server_key_iv: "0ec696a331d071dd922f1fbb0caabbf4"
server_key_version: "encryptionkey@0"
I20260807 22:48:08.663024 21223 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:48:08.665593 21238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:08.666949 21223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:48:08.667099 21223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "6ed0207a01464a40a235189255069f0e"
format_stamp: "Formatted at 2026-08-07 22:48:08 on dist-test-slave-tm1g"
server_key: "d40e56d37417cdf55cd44accf526552a"
server_key_iv: "0ec696a331d071dd922f1fbb0caabbf4"
server_key_version: "encryptionkey@0"
I20260807 22:48:08.667217 21223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:08.681535 21223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:08.684948 21223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:08.685169 21223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:08.692986 21223 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:42577
I20260807 22:48:08.693003 21291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:42577 every 8 connection(s)
I20260807 22:48:08.693984 21223 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:48:08.696869 21292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:08.699193 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 21223
I20260807 22:48:08.699383 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:48:08.699736 12739 external_mini_cluster.cc:1428] Setting key fe247cf95e3de7df76fe60e6df0c7f00
I20260807 22:48:08.703540 21292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e: Bootstrap starting.
I20260807 22:48:08.706184 21292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:08.707059 21292 log.cc:824] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:08.709573 21292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e: No bootstrap required, opened a new log
Aug 07 22:48:08 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:48:08.713083 21292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } }
I20260807 22:48:08.713310 21292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:08.713376 21292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ed0207a01464a40a235189255069f0e, State: Initialized, Role: FOLLOWER
I20260807 22:48:08.713835 21292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } }
I20260807 22:48:08.713994 21292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:48:08.714058 21292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:48:08.714171 21292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:08.715131 21295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:08.701338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49874 (local address 127.12.112.254:42577)
0807 22:48:08.701845 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:08.701878 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:08.702093 (+ 215us) server_negotiation.cc:407] Connection header received
0807 22:48:08.702873 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:08.702891 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:08.703230 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:08.703514 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:08.704421 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:08.705431 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:08.706653 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:08.707203 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:08.707340 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:08.710235 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:08.710240 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:08.710254 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:08.710281 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:08.712058 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:08.712531 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:08.712536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:08.712541 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:08.712650 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:08.712943 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:08.712946 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:08.712948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:08.713397 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:08.713621 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:08.713863 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 22:48:08.714393 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":146,"threads_started":1}
I20260807 22:48:08.715127 21292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } }
I20260807 22:48:08.715549 21292 leader_election.cc:302] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ed0207a01464a40a235189255069f0e; no voters:
I20260807 22:48:08.715907 21292 leader_election.cc:288] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:48:08.716023 21297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:08.716270 21297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 1 LEADER]: Becoming Leader. State: Replica: 6ed0207a01464a40a235189255069f0e, State: Running, Role: LEADER
I20260807 22:48:08.716564 21297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } }
I20260807 22:48:08.717157 21292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:48:08.717724 21298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ed0207a01464a40a235189255069f0e. Latest consensus state: current_term: 1 leader_uuid: "6ed0207a01464a40a235189255069f0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } } }
I20260807 22:48:08.717942 21298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:08.718189 21300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ed0207a01464a40a235189255069f0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } } }
I20260807 22:48:08.718281 21300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:08.718557 21307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:48:08.721909 21307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:48:08.727509 21307 catalog_manager.cc:1347] Generated new cluster ID: 00c4fabfdb9b424cae78e3f1407d445a
I20260807 22:48:08.727596 21307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:48:08.740972 21307 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:48:08.741971 21307 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:48:08.753557 21307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e: Generated new TSK 0
I20260807 22:48:08.754367 21307 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:48:08.789436 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:42577
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:08.922868 21319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:08.923187 21319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:08.923264 21319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:08.927383 21319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:08.927476 21319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:08.927575 21319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:48:08.932969 21319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:42577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:08.934100 21319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:08.935218 21319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:08.945096 21325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:08.945106 21327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:08.945103 21324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:08.945371 21319 server_base.cc:1034] running on GCE node
I20260807 22:48:08.945834 21319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:08.946576 21319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:08.947783 21319 hybrid_clock.cc:648] HybridClock initialized: now 1786142888947770 us; error 41 us; skew 500 ppm
Aug 07 22:48:08 dist-test-slave-tm1g krb5kdc[21210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142888, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:08.950738 21319 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:48:08.951685 21319 webserver.cc:460] Webserver started at http://127.12.112.193:45369/ using document root <none> and password file <none>
I20260807 22:48:08.952272 21319 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:08.952369 21319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:08.952616 21319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:08.954835 21319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "68f25c1e85784a80baf1206e3a8404ff"
format_stamp: "Formatted at 2026-08-07 22:48:08 on dist-test-slave-tm1g"
server_key: "e907f64c10fbd3f85bb76b0402f41a0e"
server_key_iv: "0ec096a77c2d5678959cc94af25e3a99"
server_key_version: "encryptionkey@0"
I20260807 22:48:08.955423 21319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "68f25c1e85784a80baf1206e3a8404ff"
format_stamp: "Formatted at 2026-08-07 22:48:08 on dist-test-slave-tm1g"
server_key: "e907f64c10fbd3f85bb76b0402f41a0e"
server_key_iv: "0ec096a77c2d5678959cc94af25e3a99"
server_key_version: "encryptionkey@0"
I20260807 22:48:08.959298 21319 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:48:08.961771 21334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:08.963025 21319 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:48:08.963173 21319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "68f25c1e85784a80baf1206e3a8404ff"
format_stamp: "Formatted at 2026-08-07 22:48:08 on dist-test-slave-tm1g"
server_key: "e907f64c10fbd3f85bb76b0402f41a0e"
server_key_iv: "0ec096a77c2d5678959cc94af25e3a99"
server_key_version: "encryptionkey@0"
I20260807 22:48:08.963294 21319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:08.985321 21319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:08.989077 21319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:08.989320 21319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:08.989972 21319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:08.990903 21319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:08.990976 21319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:08.991047 21319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:08.991101 21319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.000209 21319 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:44471
I20260807 22:48:09.000240 21450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:44471 every 8 connection(s)
I20260807 22:48:09.001221 21319 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:48:09.008045 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 21319
I20260807 22:48:09.008185 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:48:09.008498 12739 external_mini_cluster.cc:1428] Setting key c32ddc663ad1f9d2719d412e28de3024
Aug 07 22:48:09 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142888, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:48:09.016575 21295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:09.003078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:54309 (local address 127.12.112.254:42577)
0807 22:48:09.003229 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:09.003233 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:09.004103 (+ 870us) server_negotiation.cc:407] Connection header received
0807 22:48:09.005377 (+ 1274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:09.005379 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:09.005426 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:09.005506 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:09.006758 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.007328 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.008625 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.008976 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.009096 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:09.012106 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:09.012112 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:09.012117 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:09.012155 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:09.014117 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:09.014708 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:09.014715 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:09.014719 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:09.014817 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:09.015176 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:09.015182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:09.015187 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:09.015485 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:09.015599 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:09.016144 (+ 545us) server_negotiation.cc:299] Negotiation successful
0807 22:48:09.016312 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:48:09.017287 21454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:09.003436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:54309)
0807 22:48:09.003935 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:09.003979 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:09.005167 (+ 1188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:09.005671 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:09.005677 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:09.006044 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:09.006613 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:09.006627 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.007445 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.007448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:09.008481 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:09.008490 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.009142 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.009146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:09.009302 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:09.009968 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:09.010005 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:09.011868 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:09.014249 (+ 2381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:09.014254 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:09.014268 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:09.014606 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:09.014918 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:09.014921 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:09.014922 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:09.015065 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:09.015601 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:09.015606 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:09.015856 (+ 250us) client_negotiation.cc:769] Sending connection context
0807 22:48:09.016025 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 22:48:09.016295 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":128,"threads_started":1}
I20260807 22:48:09.018703 21451 heartbeater.cc:347] Connected to a master server at 127.12.112.254:42577
I20260807 22:48:09.018970 21451 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:09.019621 21451 heartbeater.cc:511] Master 127.12.112.254:42577 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:48:09.021201 21255 ts_manager.cc:194] Registered new tserver with Master: 68f25c1e85784a80baf1206e3a8404ff (127.12.112.193:44471)
I20260807 22:48:09.022454 21255 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:54309
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:48:09.039291 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:42577
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:09.152666 21457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:09.152966 21457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:09.153013 21457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:09.157126 21457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:09.157192 21457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:09.157289 21457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:48:09.162817 21457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:42577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:09.163964 21457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:09.165043 21457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:09.175781 21463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:09.175778 21462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:09.175771 21465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:09.175827 21457 server_base.cc:1034] running on GCE node
I20260807 22:48:09.176523 21457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:09.177217 21457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:09.178421 21457 hybrid_clock.cc:648] HybridClock initialized: now 1786142889178405 us; error 26 us; skew 500 ppm
Aug 07 22:48:09 dist-test-slave-tm1g krb5kdc[21210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142889, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:09.181419 21457 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:48:09.182466 21457 webserver.cc:460] Webserver started at http://127.12.112.194:33367/ using document root <none> and password file <none>
I20260807 22:48:09.183046 21457 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:09.183140 21457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:09.183393 21457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:09.185503 21457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "905602a9a0364d22b224a2f110d7bb0e"
format_stamp: "Formatted at 2026-08-07 22:48:09 on dist-test-slave-tm1g"
server_key: "cbc45cd1911b638349a05151946b3590"
server_key_iv: "c1ee663cc0d3f9d79759c6eb8664bf91"
server_key_version: "encryptionkey@0"
I20260807 22:48:09.186131 21457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "905602a9a0364d22b224a2f110d7bb0e"
format_stamp: "Formatted at 2026-08-07 22:48:09 on dist-test-slave-tm1g"
server_key: "cbc45cd1911b638349a05151946b3590"
server_key_iv: "c1ee663cc0d3f9d79759c6eb8664bf91"
server_key_version: "encryptionkey@0"
I20260807 22:48:09.190160 21457 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260807 22:48:09.192759 21472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.194088 21457 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:48:09.194268 21457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "905602a9a0364d22b224a2f110d7bb0e"
format_stamp: "Formatted at 2026-08-07 22:48:09 on dist-test-slave-tm1g"
server_key: "cbc45cd1911b638349a05151946b3590"
server_key_iv: "c1ee663cc0d3f9d79759c6eb8664bf91"
server_key_version: "encryptionkey@0"
I20260807 22:48:09.194454 21457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:09.208734 21457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:09.212165 21457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:09.212394 21457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:09.213150 21457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:09.214000 21457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:09.214073 21457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.214139 21457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:09.214170 21457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.228003 21457 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:39189
I20260807 22:48:09.228017 21590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:39189 every 8 connection(s)
I20260807 22:48:09.229210 21457 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:48:09.236617 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 21457
I20260807 22:48:09.236747 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:48:09.237051 12739 external_mini_cluster.cc:1428] Setting key e1ee76fbbb3149a9638a7b7bbe411fba
Aug 07 22:48:09 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142889, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:48:09.244792 21295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:09.231202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:52577 (local address 127.12.112.254:42577)
0807 22:48:09.231336 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:09.231339 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:09.232110 (+ 771us) server_negotiation.cc:407] Connection header received
0807 22:48:09.233644 (+ 1534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:09.233648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:09.233715 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:09.233844 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:09.235347 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.235928 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.237610 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.237898 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.238005 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:09.240706 (+ 2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:09.240709 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:09.240711 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:09.240737 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:09.242249 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:09.242921 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:09.242927 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:09.242932 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:09.243031 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:09.243482 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:09.243488 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:09.243493 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:09.243790 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:09.243906 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:09.244442 (+ 536us) server_negotiation.cc:299] Negotiation successful
0807 22:48:09.244585 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:48:09.245604 21593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:09.231532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:52577)
0807 22:48:09.231962 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:09.232004 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:09.233400 (+ 1396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:09.234114 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:09.234121 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:09.234550 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:09.235200 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:09.235215 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.236061 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.236065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:09.237469 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:09.237480 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.238045 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.238048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:09.238202 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:09.238921 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:09.238937 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:09.240489 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:09.242515 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:09.242520 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:09.242533 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:09.242808 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:09.243184 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:09.243187 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:09.243189 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:09.243374 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:09.243925 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:09.243930 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:09.244170 (+ 240us) client_negotiation.cc:769] Sending connection context
0807 22:48:09.244350 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 22:48:09.244616 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":111,"threads_started":1}
I20260807 22:48:09.246882 21591 heartbeater.cc:347] Connected to a master server at 127.12.112.254:42577
I20260807 22:48:09.247143 21591 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:09.247653 21591 heartbeater.cc:511] Master 127.12.112.254:42577 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:48:09.248767 21255 ts_manager.cc:194] Registered new tserver with Master: 905602a9a0364d22b224a2f110d7bb0e (127.12.112.194:39189)
I20260807 22:48:09.249370 21255 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:52577
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:48:09.267879 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:42577
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:09.380311 21596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:09.380578 21596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:09.380658 21596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:09.384704 21596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:09.384761 21596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:09.384881 21596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:48:09.390235 21596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:42577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:09.391372 21596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:09.392421 21596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:09.402190 21601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:09.402148 21604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:09.402164 21602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:09.402567 21596 server_base.cc:1034] running on GCE node
I20260807 22:48:09.402984 21596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:09.403596 21596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:09.404768 21596 hybrid_clock.cc:648] HybridClock initialized: now 1786142889404738 us; error 41 us; skew 500 ppm
Aug 07 22:48:09 dist-test-slave-tm1g krb5kdc[21210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142889, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:09.407662 21596 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:48:09.408515 21596 webserver.cc:460] Webserver started at http://127.12.112.195:43035/ using document root <none> and password file <none>
I20260807 22:48:09.409065 21596 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:09.409155 21596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:09.409395 21596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:09.411449 21596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "135f8a57c1e34886a57f29684487649f"
format_stamp: "Formatted at 2026-08-07 22:48:09 on dist-test-slave-tm1g"
server_key: "15af1a834b2c7f69b07ed2a220093a92"
server_key_iv: "d5936f0becd34adf10480dd83e39772b"
server_key_version: "encryptionkey@0"
I20260807 22:48:09.412024 21596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "135f8a57c1e34886a57f29684487649f"
format_stamp: "Formatted at 2026-08-07 22:48:09 on dist-test-slave-tm1g"
server_key: "15af1a834b2c7f69b07ed2a220093a92"
server_key_iv: "d5936f0becd34adf10480dd83e39772b"
server_key_version: "encryptionkey@0"
I20260807 22:48:09.416201 21596 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:48:09.418917 21611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.420141 21596 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:48:09.420300 21596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "135f8a57c1e34886a57f29684487649f"
format_stamp: "Formatted at 2026-08-07 22:48:09 on dist-test-slave-tm1g"
server_key: "15af1a834b2c7f69b07ed2a220093a92"
server_key_iv: "d5936f0becd34adf10480dd83e39772b"
server_key_version: "encryptionkey@0"
I20260807 22:48:09.420420 21596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:09.437072 21596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:09.440461 21596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:09.440672 21596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:09.441432 21596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:09.442222 21596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:09.442270 21596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.442382 21596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:09.442411 21596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.451709 21596 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:40501
I20260807 22:48:09.451736 21729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:40501 every 8 connection(s)
I20260807 22:48:09.452617 21596 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:48:09.454790 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 21596
I20260807 22:48:09.454941 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:48:09.455325 12739 external_mini_cluster.cc:1428] Setting key 3f8530a9610655439a54f8880a2310b8
Aug 07 22:48:09 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142889, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:48:09.466564 21295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:09.454400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:38001 (local address 127.12.112.254:42577)
0807 22:48:09.454551 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:09.454555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:09.455620 (+ 1065us) server_negotiation.cc:407] Connection header received
0807 22:48:09.457255 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:09.457258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:09.457329 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:09.457417 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:09.458729 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.459285 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.460420 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.460647 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.460734 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:09.463312 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:09.463315 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:09.463317 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:09.463341 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:09.464595 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:09.465090 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:09.465092 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:09.465094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:09.465168 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:09.465491 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:09.465493 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:09.465494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:09.465661 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:09.465734 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:09.466288 (+ 554us) server_negotiation.cc:299] Negotiation successful
0807 22:48:09.466444 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:48:09.467476 21732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:09.454898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:38001)
0807 22:48:09.455461 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:09.455517 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:09.457048 (+ 1531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:09.457641 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:09.457648 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:09.458017 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:09.458589 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:09.458603 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.459405 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.459407 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:09.460302 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:09.460311 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.460827 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.460830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:09.460983 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:09.461630 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:09.461646 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:09.463149 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:09.464713 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:09.464718 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:09.464729 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:09.464993 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:09.465245 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:09.465247 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:09.465248 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:09.465402 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:09.465802 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:09.465807 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:09.466035 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 22:48:09.466195 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 22:48:09.466530 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":159,"threads_started":1}
I20260807 22:48:09.468737 21730 heartbeater.cc:347] Connected to a master server at 127.12.112.254:42577
I20260807 22:48:09.469007 21730 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:09.469552 21730 heartbeater.cc:511] Master 127.12.112.254:42577 requested a full tablet report, sending...
I20260807 22:48:09.470592 21254 ts_manager.cc:194] Registered new tserver with Master: 135f8a57c1e34886a57f29684487649f (127.12.112.195:40501)
I20260807 22:48:09.471210 21254 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:38001
I20260807 22:48:09.481148 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab.
Entry for principal oryx/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab.
WARNING: no policy specified for oryx/127.12.112.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab.
Entry for principal oryx/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab.
WARNING: no policy specified for oryx/127.12.112.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.112.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab.
Entry for principal oryx/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab.
I20260807 22:48:09.554356 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 21319
I20260807 22:48:09.562667 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 21457
I20260807 22:48:09.569187 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 21596
I20260807 22:48:09.581236 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 21223
I20260807 22:48:09.588820 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:42577
--webserver_interface=127.12.112.254
--webserver_port=35681
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:42577
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:09.701977 21739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:09.702234 21739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:09.702273 21739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:09.706375 21739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:48:09.706434 21739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:09.706452 21739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:09.706470 21739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:48:09.706511 21739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:48:09.711695 21739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:42577
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:42577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=35681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:09.712724 21739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:09.713747 21739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:09.722100 21748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:09.722157 21746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:09.722255 21739 server_base.cc:1034] running on GCE node
W20260807 22:48:09.722198 21745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:09.723093 21739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:09.724136 21739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:09.725324 21739 hybrid_clock.cc:648] HybridClock initialized: now 1786142889725288 us; error 53 us; skew 500 ppm
Aug 07 22:48:09 dist-test-slave-tm1g krb5kdc[21210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142889, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:09.728096 21739 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:48:09.728945 21739 webserver.cc:460] Webserver started at http://127.12.112.254:35681/ using document root <none> and password file <none>
I20260807 22:48:09.729444 21739 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:09.729516 21739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:09.733582 21739 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:48:09.735714 21757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.736925 21739 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:48:09.737063 21739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "6ed0207a01464a40a235189255069f0e"
format_stamp: "Formatted at 2026-08-07 22:48:08 on dist-test-slave-tm1g"
server_key: "d40e56d37417cdf55cd44accf526552a"
server_key_iv: "0ec696a331d071dd922f1fbb0caabbf4"
server_key_version: "encryptionkey@0"
I20260807 22:48:09.737587 21739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:09.783527 21739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:09.786651 21739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:09.786857 21739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:09.793936 21739 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:42577
I20260807 22:48:09.793962 21812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:42577 every 8 connection(s)
I20260807 22:48:09.795042 21739 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:48:09.797235 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 21739
I20260807 22:48:09.797698 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:44471
--local_ip_for_outbound_sockets=127.12.112.193
--tserver_master_addrs=127.12.112.254:42577
--webserver_port=45369
--webserver_interface=127.12.112.193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.112.193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:48:09.799404 21813 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:48:09.801055 21813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e: Bootstrap starting.
I20260807 22:48:09.817870 21813 log.cc:824] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:09.824317 21813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:48:09.824693 21813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e: Bootstrap complete.
I20260807 22:48:09.828969 21813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } }
I20260807 22:48:09.829387 21813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ed0207a01464a40a235189255069f0e, State: Initialized, Role: FOLLOWER
I20260807 22:48:09.829907 21813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } }
I20260807 22:48:09.830055 21813 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:48:09.830143 21813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:48:09.830260 21813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:48:09.832186 21813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } }
I20260807 22:48:09.832515 21813 leader_election.cc:302] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ed0207a01464a40a235189255069f0e; no voters:
I20260807 22:48:09.832844 21813 leader_election.cc:288] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:48:09.832930 21817 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:48:09.833118 21817 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [term 2 LEADER]: Becoming Leader. State: Replica: 6ed0207a01464a40a235189255069f0e, State: Running, Role: LEADER
I20260807 22:48:09.833463 21817 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } }
I20260807 22:48:09.834040 21813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:48:09.834384 21819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ed0207a01464a40a235189255069f0e. Latest consensus state: current_term: 2 leader_uuid: "6ed0207a01464a40a235189255069f0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } } }
I20260807 22:48:09.834517 21819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:09.834766 21818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6ed0207a01464a40a235189255069f0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ed0207a01464a40a235189255069f0e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 42577 } } }
I20260807 22:48:09.834882 21818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:09.835217 21821 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:48:09.838413 21821 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:48:09.839035 21821 catalog_manager.cc:1259] Loaded cluster ID: 00c4fabfdb9b424cae78e3f1407d445a
I20260807 22:48:09.839100 21821 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:48:09.841431 21821 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:48:09.842164 21821 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6ed0207a01464a40a235189255069f0e: Loaded TSK: 0
I20260807 22:48:09.843446 21821 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:48:09.911931 21815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:09.912210 21815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:09.912285 21815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:09.916383 21815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:09.916464 21815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:09.916554 21815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:48:09.921716 21815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.193.keytab
--principal=oryx/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:44471
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=45369
--tserver_master_addrs=127.12.112.254:42577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:09.922823 21815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:09.924023 21815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:09.933423 21842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:09.933471 21841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:09.933450 21844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:09.934053 21815 server_base.cc:1034] running on GCE node
I20260807 22:48:09.934535 21815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:09.935293 21815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:09.936476 21815 hybrid_clock.cc:648] HybridClock initialized: now 1786142889936446 us; error 44 us; skew 500 ppm
Aug 07 22:48:09 dist-test-slave-tm1g krb5kdc[21210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142889, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:09.939924 21815 init.cc:377] Logged in from keytab as oryx/127.12.112.193@KRBTEST.COM (short username oryx)
I20260807 22:48:09.941012 21815 webserver.cc:460] Webserver started at http://127.12.112.193:45369/ using document root <none> and password file <none>
I20260807 22:48:09.941706 21815 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:09.941830 21815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:09.946923 21815 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:48:09.949492 21853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.951042 21815 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:48:09.951167 21815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "68f25c1e85784a80baf1206e3a8404ff"
format_stamp: "Formatted at 2026-08-07 22:48:08 on dist-test-slave-tm1g"
server_key: "e907f64c10fbd3f85bb76b0402f41a0e"
server_key_iv: "0ec096a77c2d5678959cc94af25e3a99"
server_key_version: "encryptionkey@0"
I20260807 22:48:09.951865 21815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:09.967790 21815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:09.971340 21815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:09.971535 21815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:09.972292 21815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:09.973286 21815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:09.973361 21815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.973418 21815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:09.973445 21815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:09.984553 21815 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:44471
I20260807 22:48:09.984633 21976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:44471 every 8 connection(s)
I20260807 22:48:09.985718 21815 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:48:09.994901 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 21815
I20260807 22:48:09.995361 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:39189
--local_ip_for_outbound_sockets=127.12.112.194
--tserver_master_addrs=127.12.112.254:42577
--webserver_port=33367
--webserver_interface=127.12.112.194
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.112.194
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:48:09 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:09 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:48:09.999962 21981 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:09.989085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:40553 (local address 127.12.112.254:42577)
0807 22:48:09.989626 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:09.989644 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:09.989688 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:48:09.990343 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:09.990359 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:09.990731 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:09.991083 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:09.992107 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.993557 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.994881 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.995389 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.995572 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:09.999266 (+ 3694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:40553: BlockingRecv error: recv got EOF from 127.12.112.193:40553 (error 108)
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":151,"threads_started":1}
I20260807 22:48:10.000048 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:09.987962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:40553)
0807 22:48:09.988435 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:09.988487 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:09.989883 (+ 1396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:09.991138 (+ 1255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:09.991144 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:09.991483 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:09.991928 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:09.991941 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.993702 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.993705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:09.994744 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:09.994759 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:09.995562 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:09.995566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:09.995753 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:09.996360 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:09.996376 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:09.999085 (+ 2709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":132,"threads_started":1}
W20260807 22:48:10.000715 21977 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:42577 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.112.254:42577: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:10.007573 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:10.001226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:51839)
0807 22:48:10.001431 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:10.001447 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:10.001545 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:10.001794 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:10.001799 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:10.001984 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:10.002126 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.002137 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.002972 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.002978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.004017 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.004032 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.004500 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.004507 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.004630 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.005103 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:10.005123 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:10.007430 (+ 2307us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122}
W20260807 22:48:10.007669 21981 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:10.001337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:51839 (local address 127.12.112.254:42577)
0807 22:48:10.001457 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:10.001460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:10.001495 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:48:10.001632 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:10.001634 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:10.001673 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:10.001748 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:10.002286 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.002855 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.004156 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.004372 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.004461 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.007561 (+ 3100us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:51839: BlockingRecv error: recv got EOF from 127.12.112.193:51839 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:10.013293 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:10.008203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:46619)
0807 22:48:10.008318 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:10.008332 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:10.008406 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:10.008821 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:10.008824 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:10.008982 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:10.009050 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.009055 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.009801 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.009805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.010388 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.010398 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.010837 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.010841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.010920 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.011403 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:10.011417 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:10.013170 (+ 1753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 22:48:10.013507 21977 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:48:10.013597 21981 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:10.008525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:46619 (local address 127.12.112.254:42577)
0807 22:48:10.008636 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:10.008639 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:10.008650 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:48:10.008678 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:10.008680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:10.008713 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:10.008805 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:10.009161 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.009677 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.010507 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.010719 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.010826 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.013320 (+ 2494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:46619: BlockingRecv error: recv got EOF from 127.12.112.193:46619 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 22:48:10.108510 21984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:10.108747 21984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:10.108788 21984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:10.112829 21984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:10.112888 21984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:10.112973 21984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:48:10.118049 21984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.194.keytab
--principal=oryx/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:39189
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=33367
--tserver_master_addrs=127.12.112.254:42577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:10.119439 21984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:10.120446 21984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:10.130095 21990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:10.130127 21992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:10.130141 21989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:10.130285 21984 server_base.cc:1034] running on GCE node
I20260807 22:48:10.130818 21984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:10.131501 21984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:10.132658 21984 hybrid_clock.cc:648] HybridClock initialized: now 1786142890132626 us; error 43 us; skew 500 ppm
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142890, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:10.135792 21984 init.cc:377] Logged in from keytab as oryx/127.12.112.194@KRBTEST.COM (short username oryx)
I20260807 22:48:10.136644 21984 webserver.cc:460] Webserver started at http://127.12.112.194:33367/ using document root <none> and password file <none>
I20260807 22:48:10.137199 21984 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:10.137300 21984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:10.141160 21984 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:48:10.143458 22000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:10.144677 21984 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:48:10.144897 21984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "905602a9a0364d22b224a2f110d7bb0e"
format_stamp: "Formatted at 2026-08-07 22:48:09 on dist-test-slave-tm1g"
server_key: "cbc45cd1911b638349a05151946b3590"
server_key_iv: "c1ee663cc0d3f9d79759c6eb8664bf91"
server_key_version: "encryptionkey@0"
I20260807 22:48:10.145442 21984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:10.159572 21984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:10.162854 21984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:10.163055 21984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:10.163657 21984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:10.164479 21984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:10.164538 21984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:10.164579 21984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:10.164631 21984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:10.173344 21984 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:39189
I20260807 22:48:10.173422 22119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:39189 every 8 connection(s)
I20260807 22:48:10.174428 21984 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:48:10.183109 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 21984
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:10.183621 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:40501
--local_ip_for_outbound_sockets=127.12.112.195
--tserver_master_addrs=127.12.112.254:42577
--webserver_port=43035
--webserver_interface=127.12.112.195
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.112.195
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:48:10.185326 21981 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:10.176195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:38963 (local address 127.12.112.254:42577)
0807 22:48:10.176343 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:10.176349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:10.177197 (+ 848us) server_negotiation.cc:407] Connection header received
0807 22:48:10.178448 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:10.178450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:10.178503 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:10.178579 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:10.179675 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.180201 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.181367 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.181574 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.181648 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.185175 (+ 3527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:38963: BlockingRecv error: recv got EOF from 127.12.112.194:38963 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:48:10.185923 22122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:10.176605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:38963)
0807 22:48:10.177052 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:10.177093 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:10.178219 (+ 1126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:10.178734 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:10.178740 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:10.179065 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:10.179544 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.179556 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.180342 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.180345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.181257 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.181266 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.181701 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.181703 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.181838 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.182470 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:10.182487 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:10.185039 (+ 2552us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":122,"threads_started":1}
W20260807 22:48:10.186477 22120 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:42577 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.112.254:42577: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:10.192632 22122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:10.186916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:38237)
0807 22:48:10.187079 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:10.187096 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:10.187180 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:10.187423 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:10.187429 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:10.187611 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:10.187749 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.187759 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.188465 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.188471 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.189502 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.189516 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.189943 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.189949 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.190077 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.190586 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:10.190607 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:10.192485 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":70}
W20260807 22:48:10.192723 21981 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:10.187046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:38237 (local address 127.12.112.254:42577)
0807 22:48:10.187144 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:10.187147 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:10.187159 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:48:10.187275 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:10.187277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:10.187314 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:10.187379 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:10.187872 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.188355 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.189625 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.189826 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.189900 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.192602 (+ 2702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:38237: BlockingRecv error: recv got EOF from 127.12.112.194:38237 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:10.198134 22122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:10.193220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:35837)
0807 22:48:10.193334 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:10.193349 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:10.193423 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:10.193679 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:10.193682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:10.193832 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:10.193897 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.193901 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.194669 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.194672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.195182 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.195189 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.195626 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.195630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.195716 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.196183 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:10.196194 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:10.198001 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 22:48:10.198228 21981 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:10.193343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:35837 (local address 127.12.112.254:42577)
0807 22:48:10.193482 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:10.193488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:10.193519 (+ 31us) server_negotiation.cc:407] Connection header received
0807 22:48:10.193547 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:10.193549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:10.193579 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:10.193663 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:10.194005 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.194555 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.195297 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.195512 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.195615 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.198119 (+ 2504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:35837: BlockingRecv error: recv got EOF from 127.12.112.194:35837 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 22:48:10.198423 22120 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:48:10.299311 22123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:10.299629 22123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:10.299710 22123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:10.303829 22123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:10.303938 22123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:10.304039 22123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:48:10.309470 22123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/krb5kdc/oryx_127.12.112.195.keytab
--principal=oryx/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:40501
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=43035
--tserver_master_addrs=127.12.112.254:42577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:10.310691 22123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:10.311746 22123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:10.321557 22131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:10.321563 22130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:10.321557 22133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:10.321905 22123 server_base.cc:1034] running on GCE node
I20260807 22:48:10.322376 22123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:10.323038 22123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:10.324245 22123 hybrid_clock.cc:648] HybridClock initialized: now 1786142890324206 us; error 43 us; skew 500 ppm
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142890, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:10.327211 22123 init.cc:377] Logged in from keytab as oryx/127.12.112.195@KRBTEST.COM (short username oryx)
I20260807 22:48:10.328161 22123 webserver.cc:460] Webserver started at http://127.12.112.195:43035/ using document root <none> and password file <none>
I20260807 22:48:10.328684 22123 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:10.328755 22123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:10.332647 22123 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:48:10.334720 22141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:10.336103 22123 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:48:10.336238 22123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "135f8a57c1e34886a57f29684487649f"
format_stamp: "Formatted at 2026-08-07 22:48:09 on dist-test-slave-tm1g"
server_key: "15af1a834b2c7f69b07ed2a220093a92"
server_key_iv: "d5936f0becd34adf10480dd83e39772b"
server_key_version: "encryptionkey@0"
I20260807 22:48:10.336844 22123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:10.350672 22123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:10.353600 22123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:10.353803 22123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:10.354473 22123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:10.355304 22123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:10.355383 22123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:10.355479 22123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:10.355532 22123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:10.364455 22123 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:40501
I20260807 22:48:10.364513 22258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:40501 every 8 connection(s)
I20260807 22:48:10.365540 22123 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:48:10.371245 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 22123
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:48:10.377004 21981 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:10.367411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:48141 (local address 127.12.112.254:42577)
0807 22:48:10.367555 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:10.367559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:10.368408 (+ 849us) server_negotiation.cc:407] Connection header received
0807 22:48:10.369710 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:10.369713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:10.369774 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:10.369895 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:10.371054 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.371664 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.373164 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.373384 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.373461 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.376827 (+ 3366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:48141: BlockingRecv error: recv got EOF from 127.12.112.195:48141 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:48:10.377748 22262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:10.367799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:48141)
0807 22:48:10.368246 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:10.368286 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:10.369502 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:10.370066 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:10.370072 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:10.370445 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:10.370906 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.370919 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.371791 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.371795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.373041 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.373054 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.373540 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.373547 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.373722 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.374371 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:10.374388 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:10.376668 (+ 2280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":122,"threads_started":1}
W20260807 22:48:10.378233 22260 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:42577 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.112.254:42577: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
I20260807 22:48:10.381281 22265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:10.372317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49880 (local address 127.12.112.254:42577)
0807 22:48:10.372549 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:10.372553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:10.372565 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:48:10.372594 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:10.372596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:10.372629 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:10.372704 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:10.373610 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.374098 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.375031 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.375276 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.375378 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.376833 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:10.376847 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:10.376865 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:10.376897 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:10.378995 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:10.379532 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:10.379539 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:10.379547 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:10.379695 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:10.379971 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:10.379974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:10.379975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:10.380411 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:10.380556 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:10.380855 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 22:48:10.381117 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":105,"threads_started":1}
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:10.384199 22262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:10.378736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:48543)
0807 22:48:10.378830 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:10.378845 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:10.378930 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:10.379147 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:10.379150 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:10.379318 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:10.379448 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.379459 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.380337 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.380339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.381108 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.381118 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.381648 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.381651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.381755 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.382154 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:10.382163 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:10.384064 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 22:48:10.384285 21981 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:10.378805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:48543 (local address 127.12.112.254:42577)
0807 22:48:10.378941 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:10.378945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:10.378961 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:48:10.378995 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:10.378998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:10.379040 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:10.379117 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:10.379554 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.380228 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.381214 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.381524 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.381634 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.384173 (+ 2539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:48543: BlockingRecv error: recv got EOF from 127.12.112.195:48543 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:10 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:10.389456 22262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:10.384844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:35889)
0807 22:48:10.384994 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:10.385011 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:10.385093 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:10.385333 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:10.385336 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:10.385463 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:10.385545 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.385550 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.386206 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.386208 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.386805 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:10.386814 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.387198 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.387200 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:10.387256 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.387646 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:10.387656 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:10.389317 (+ 1661us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260807 22:48:10.389536 21981 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:10.384964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:35889 (local address 127.12.112.254:42577)
0807 22:48:10.385107 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:10.385110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:10.385123 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:48:10.385156 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:10.385158 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:10.385188 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:10.385265 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:10.385646 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.386108 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.386910 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:10.387107 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:10.387181 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:10.389424 (+ 2243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:35889: BlockingRecv error: recv got EOF from 127.12.112.195:35889 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260807 22:48:10.389698 22260 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 22:48:11 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:11 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:11.019603 22266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:11.014142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:41311)
0807 22:48:11.014460 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:11.014473 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:11.014563 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:11.014799 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:11.014801 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:11.014982 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:11.015101 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:11.015106 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.015895 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.015898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:11.016499 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:11.016506 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.016947 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.016949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:11.017020 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:11.017531 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:11.017543 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:11.019426 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":97,"threads_started":1}
W20260807 22:48:11.019682 22267 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:11.014269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:41311 (local address 127.12.112.254:42577)
0807 22:48:11.014587 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:11.014591 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:11.014604 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:48:11.014638 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:11.014641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:11.014681 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:11.014761 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:11.015240 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.015794 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.016612 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.016843 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.016927 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:11.019555 (+ 2628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:41311: BlockingRecv error: recv got EOF from 127.12.112.193:41311 (error 108)
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":127,"threads_started":1}
Aug 07 22:48:11 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:11 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:11.204573 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:11.199069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:55275)
0807 22:48:11.199376 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:11.199391 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:11.199527 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:11.199803 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:11.199806 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:11.200029 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:11.200127 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:11.200132 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.200915 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.200920 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:11.201498 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:11.201506 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.201972 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.201975 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:11.202062 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:11.202582 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:11.202594 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:11.204406 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":99,"threads_started":1}
W20260807 22:48:11.204671 22267 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:11.199147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:55275 (local address 127.12.112.254:42577)
0807 22:48:11.199336 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:11.199341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:11.199473 (+ 132us) server_negotiation.cc:407] Connection header received
0807 22:48:11.199630 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:11.199635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:11.199685 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:11.199779 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:11.200248 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.200794 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.201618 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.201855 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.201968 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:11.204557 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:55275: BlockingRecv error: recv got EOF from 127.12.112.194:55275 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 07 22:48:11 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:11 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:11.395816 22269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:11.390375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:33063)
0807 22:48:11.390658 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:11.390672 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:11.390770 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:11.390988 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:11.390990 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:11.391177 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:11.391296 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:11.391302 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.392045 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.392048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:11.392612 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:11.392619 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.393045 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.393047 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:11.393117 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:11.393625 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:11.393636 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:11.395646 (+ 2010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":103,"threads_started":1}
W20260807 22:48:11.395891 22267 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:11.390419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:33063 (local address 127.12.112.254:42577)
0807 22:48:11.390571 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:11.390576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:11.390746 (+ 170us) server_negotiation.cc:407] Connection header received
0807 22:48:11.390838 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:11.390840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:11.390888 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:11.390953 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:11.391406 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.391954 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.392721 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:11.392947 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:11.393030 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:11.395777 (+ 2747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:33063: BlockingRecv error: recv got EOF from 127.12.112.195:33063 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 22:48:12 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:12 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:12.026476 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:12.020583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:45903)
0807 22:48:12.020915 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:12.020950 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:12.021068 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:12.021424 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:12.021427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:12.021681 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:12.021825 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:12.021833 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.022674 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.022677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:12.023238 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:12.023245 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.023671 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.023673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:12.023734 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:12.024286 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:12.024308 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:12.026259 (+ 1951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":103,"threads_started":1}
W20260807 22:48:12.026584 22271 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:12.020707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:45903 (local address 127.12.112.254:42577)
0807 22:48:12.020992 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:12.020996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:12.021010 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:48:12.021188 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:12.021194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:12.021256 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:12.021370 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:12.021974 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.022572 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.023345 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.023574 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.023653 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:12.026441 (+ 2788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:45903: BlockingRecv error: recv got EOF from 127.12.112.193:45903 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":80,"threads_started":1}
Aug 07 22:48:12 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:12 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:12.210785 22273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:12.205629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:53673)
0807 22:48:12.205900 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:12.205913 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:12.206022 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:12.206261 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:12.206263 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:12.206464 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:12.206563 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:12.206568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.207271 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.207273 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:12.207818 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:12.207825 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.208240 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.208243 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:12.208305 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:12.208788 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:12.208800 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:12.210643 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":88,"threads_started":1}
W20260807 22:48:12.210906 22271 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:12.205686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:53673 (local address 127.12.112.254:42577)
0807 22:48:12.205847 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:12.205852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:12.205986 (+ 134us) server_negotiation.cc:407] Connection header received
0807 22:48:12.206106 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:12.206108 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:12.206157 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:12.206226 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:12.206662 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.207181 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.207924 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.208140 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.208224 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:12.210787 (+ 2563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:53673: BlockingRecv error: recv got EOF from 127.12.112.194:53673 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 22:48:12 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:12 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:12.405439 22274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:12.396607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:41665)
0807 22:48:12.396937 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:12.396955 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:12.397093 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:12.397384 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:12.397387 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:12.397595 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:12.397689 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:12.397694 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.398555 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.398560 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:12.399148 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:12.399157 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.399634 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.399637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:12.399723 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:12.403297 (+ 3574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:12.403313 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:12.405304 (+ 1991us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":109,"threads_started":1}
W20260807 22:48:12.405606 22271 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:12.396803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:41665 (local address 127.12.112.254:42577)
0807 22:48:12.396958 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:12.396962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:12.397040 (+ 78us) server_negotiation.cc:407] Connection header received
0807 22:48:12.397202 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:12.397205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:12.397258 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:12.397347 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:12.397809 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.398447 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.399270 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:12.399500 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:12.399618 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:12.405473 (+ 5855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:41665: BlockingRecv error: recv got EOF from 127.12.112.195:41665 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 07 22:48:13 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:13 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:13.032868 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:13.027340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:38711)
0807 22:48:13.027670 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:13.027684 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:13.027780 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:13.028051 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:13.028053 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:13.028247 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:13.028356 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:13.028360 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.029088 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.029090 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:13.029664 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:13.029672 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.030084 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.030087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:13.030149 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:13.030744 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:13.030757 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:13.032675 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":95,"threads_started":1}
W20260807 22:48:13.032949 22276 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:13.027473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:38711 (local address 127.12.112.254:42577)
0807 22:48:13.027717 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:13.027721 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:13.027735 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:48:13.027885 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:13.027888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:13.027933 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:13.028010 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:13.028461 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.028996 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.029764 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.029989 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.030062 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:13.032814 (+ 2752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:38711: BlockingRecv error: recv got EOF from 127.12.112.193:38711 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":61,"threads_started":1}
Aug 07 22:48:13 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:13 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:13.217136 22277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:13.211647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:58223)
0807 22:48:13.211976 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:13.211990 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:13.212089 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:13.212329 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:13.212331 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:13.212529 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:13.212632 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:13.212637 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.213431 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.213434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:13.214008 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:13.214016 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.214465 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.214467 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:13.214536 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:13.215101 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:13.215112 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:13.217018 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":129,"threads_started":1}
W20260807 22:48:13.217322 22276 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:13.211791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:58223 (local address 127.12.112.254:42577)
0807 22:48:13.211955 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:13.211958 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:13.212058 (+ 100us) server_negotiation.cc:407] Connection header received
0807 22:48:13.212170 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:13.212172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:13.212217 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:13.212291 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:13.212732 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.213317 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.214112 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.214366 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.214443 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:13.217161 (+ 2718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:58223: BlockingRecv error: recv got EOF from 127.12.112.194:58223 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 22:48:13 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:13 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:13.412225 22278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:13.406440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:38551)
0807 22:48:13.406746 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:13.406765 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:13.406897 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:13.407248 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:13.407252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:13.407523 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:13.407655 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:13.407664 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.408568 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.408571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:13.409156 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:13.409164 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.409632 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.409635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:13.409704 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:13.410233 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:13.410244 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:13.412091 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":102,"threads_started":1}
W20260807 22:48:13.412345 22276 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:13.406489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:38551 (local address 127.12.112.254:42577)
0807 22:48:13.406655 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:13.406660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:13.406853 (+ 193us) server_negotiation.cc:407] Connection header received
0807 22:48:13.407021 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:13.407025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:13.407084 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:13.407184 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:13.407782 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.408462 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.409270 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:13.409494 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:13.409579 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:13.412226 (+ 2647us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:38551: BlockingRecv error: recv got EOF from 127.12.112.195:38551 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 07 22:48:14 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:14 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:14.039659 22279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:14.033699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:45649)
0807 22:48:14.034032 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:14.034045 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:14.034144 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:14.034513 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:14.034515 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:14.034698 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:14.034800 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:14.034805 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.035711 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.035714 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:14.036326 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:14.036334 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.036781 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.036783 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:14.036845 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:14.037344 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:14.037355 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:14.039493 (+ 2138us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":94,"threads_started":1}
W20260807 22:48:14.039820 22280 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:14.033749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:45649 (local address 127.12.112.254:42577)
0807 22:48:14.034044 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:14.034047 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:14.034096 (+ 49us) server_negotiation.cc:407] Connection header received
0807 22:48:14.034294 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:14.034314 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:14.034387 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:14.034473 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:14.034951 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.035616 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.036427 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.036679 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.036760 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:14.039651 (+ 2891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:45649: BlockingRecv error: recv got EOF from 127.12.112.193:45649 (error 108)
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":61,"threads_started":1}
Aug 07 22:48:14 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:14 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:14.223872 22281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:14.217963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:51743)
0807 22:48:14.218327 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:14.218342 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:14.218487 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:14.218771 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:14.218774 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:14.218999 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:14.219097 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:14.219103 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.219868 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.219873 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:14.220432 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:14.220439 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.220895 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.220898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:14.220977 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:14.221489 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:14.221501 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:14.223708 (+ 2207us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":114,"threads_started":1}
W20260807 22:48:14.223986 22280 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:14.218043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:51743 (local address 127.12.112.254:42577)
0807 22:48:14.218257 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:14.218262 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:14.218430 (+ 168us) server_negotiation.cc:407] Connection header received
0807 22:48:14.218598 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:14.218602 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:14.218656 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:14.218743 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:14.219219 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.219756 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.220551 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.220779 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.220893 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:14.223858 (+ 2965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:51743: BlockingRecv error: recv got EOF from 127.12.112.194:51743 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Aug 07 22:48:14 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:14 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:14.418906 22282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:14.413134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:47153)
0807 22:48:14.413503 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:14.413518 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:14.413659 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:14.413952 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:14.413955 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:14.414180 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:14.414282 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:14.414288 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.415131 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.415136 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:14.415707 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:14.415715 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.416195 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.416198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:14.416288 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:14.416825 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:14.416837 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:14.418722 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":113,"threads_started":1}
W20260807 22:48:14.418957 22280 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:14.413273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:47153 (local address 127.12.112.254:42577)
0807 22:48:14.413465 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:14.413471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:14.413600 (+ 129us) server_negotiation.cc:407] Connection header received
0807 22:48:14.413770 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:14.413774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:14.413837 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:14.413926 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:14.414454 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.415016 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.415841 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:14.416070 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:14.416179 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:14.418849 (+ 2670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:47153: BlockingRecv error: recv got EOF from 127.12.112.195:47153 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 07 22:48:15 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:15 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:15.046566 22283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:15.040613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:51661)
0807 22:48:15.040991 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:15.041008 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:15.041122 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:15.041420 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:15.041423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:15.041649 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:15.041746 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:15.041752 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.042639 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.042644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:15.043309 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:15.043318 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.043812 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.043816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:15.043905 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:15.044429 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:15.044441 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:15.046386 (+ 1945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":116,"threads_started":1}
W20260807 22:48:15.046653 22284 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:15.040657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:51661 (local address 127.12.112.254:42577)
0807 22:48:15.040980 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:15.040984 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:15.041086 (+ 102us) server_negotiation.cc:407] Connection header received
0807 22:48:15.041242 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:15.041246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:15.041297 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:15.041393 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:15.041869 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.042530 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.043436 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.043674 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.043804 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:15.046516 (+ 2712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:51661: BlockingRecv error: recv got EOF from 127.12.112.193:51661 (error 108)
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":94,"threads_started":1}
Aug 07 22:48:15 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:15 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:15.229971 22285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:15.224690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:38949)
0807 22:48:15.225010 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:15.225025 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:15.225119 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:15.225363 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:15.225365 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:15.225563 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:15.225661 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:15.225666 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.226417 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.226420 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:15.226970 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:15.226978 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.227380 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.227383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:15.227446 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:15.228001 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:15.228034 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:15.229851 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":88,"threads_started":1}
W20260807 22:48:15.230132 22284 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:15.224861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:38949 (local address 127.12.112.254:42577)
0807 22:48:15.225029 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:15.225032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:15.225074 (+ 42us) server_negotiation.cc:407] Connection header received
0807 22:48:15.225205 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:15.225207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:15.225248 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:15.225326 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:15.225760 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.226279 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.227068 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.227277 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.227353 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:15.229976 (+ 2623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:38949: BlockingRecv error: recv got EOF from 127.12.112.194:38949 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 07 22:48:15 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:15 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:15.425154 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:15.419753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:56965)
0807 22:48:15.420071 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:15.420085 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:15.420181 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:15.420483 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:15.420485 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:15.420674 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:15.420818 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:15.420828 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.421597 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.421600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:15.422182 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:15.422190 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.422653 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.422655 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:15.422720 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:15.423197 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:15.423208 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:15.425036 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":110,"threads_started":1}
W20260807 22:48:15.425328 22284 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:15.419809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:56965 (local address 127.12.112.254:42577)
0807 22:48:15.419972 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:15.419976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:15.420166 (+ 190us) server_negotiation.cc:407] Connection header received
0807 22:48:15.420255 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:15.420259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:15.420346 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:15.420415 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:15.420965 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.421504 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.422283 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:15.422556 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:15.422633 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:15.425175 (+ 2542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:56965: BlockingRecv error: recv got EOF from 127.12.112.195:56965 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 22:48:16 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:16 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:16.053082 22287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:16.047535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:42805)
0807 22:48:16.047847 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:16.047863 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:16.048010 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:16.048315 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:16.048318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:16.048505 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:16.048605 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:16.048610 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.049458 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.049461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:16.050111 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:16.050120 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.050567 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.050570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:16.050634 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:16.051111 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:16.051122 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:16.052963 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":81,"threads_started":1}
W20260807 22:48:16.053278 22288 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:16.047571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:42805 (local address 127.12.112.254:42577)
0807 22:48:16.047840 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:16.047844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:16.047943 (+ 99us) server_negotiation.cc:407] Connection header received
0807 22:48:16.048128 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:16.048133 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:16.048191 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:16.048269 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:16.048715 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.049343 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.050211 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.050461 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.050538 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:16.053100 (+ 2562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:42805: BlockingRecv error: recv got EOF from 127.12.112.193:42805 (error 108)
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":77,"threads_started":1}
Aug 07 22:48:16 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:16 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:16.236601 22289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:16.230835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:51339)
0807 22:48:16.231121 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:16.231134 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:16.231236 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:16.231481 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:16.231483 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:16.231681 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:16.231786 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:16.231791 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.232691 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.232699 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:16.233329 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:16.233338 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.233786 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.233789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:16.233877 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:16.234470 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:16.234482 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:16.236428 (+ 1946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":107,"threads_started":1}
W20260807 22:48:16.236658 22288 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:16.230927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:51339 (local address 127.12.112.254:42577)
0807 22:48:16.231074 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:16.231078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:16.231204 (+ 126us) server_negotiation.cc:407] Connection header received
0807 22:48:16.231318 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:16.231321 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:16.231365 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:16.231448 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:16.231910 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.232581 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.233438 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.233654 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.233735 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:16.236551 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:51339: BlockingRecv error: recv got EOF from 127.12.112.194:51339 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 22:48:16 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:16 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:16.432186 22290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:16.426145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:34235)
0807 22:48:16.426473 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:16.426487 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:16.426590 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:16.426824 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:16.426825 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:16.427024 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:16.427124 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:16.427129 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.428270 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.428277 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:16.428931 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:16.428941 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.429434 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.429438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:16.429525 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:16.430060 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:16.430072 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:16.432010 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":99,"threads_started":1}
W20260807 22:48:16.432232 22288 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:16.426215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:34235 (local address 127.12.112.254:42577)
0807 22:48:16.426411 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:16.426416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:16.426559 (+ 143us) server_negotiation.cc:407] Connection header received
0807 22:48:16.426670 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:16.426672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:16.426717 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:16.426785 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:16.427322 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.428166 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.429063 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:16.429311 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:16.429425 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:16.432129 (+ 2704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:34235: BlockingRecv error: recv got EOF from 127.12.112.195:34235 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 22:48:17 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:17 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:17.059623 22291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:17.053907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:37471)
0807 22:48:17.054330 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:17.054347 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:17.054455 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:17.054690 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:17.054692 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:17.054890 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:17.054988 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:17.054993 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.055725 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.055727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:17.056336 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:17.056346 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.056839 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.056843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:17.056921 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:17.057565 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:17.057577 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:17.059504 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":95,"threads_started":1}
W20260807 22:48:17.059795 22292 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:17.053990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:37471 (local address 127.12.112.254:42577)
0807 22:48:17.054256 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:17.054260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:17.054424 (+ 164us) server_negotiation.cc:407] Connection header received
0807 22:48:17.054529 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:17.054531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:17.054575 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:17.054651 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:17.055084 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.055632 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.056483 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.056715 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.056793 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:17.059647 (+ 2854us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:37471: BlockingRecv error: recv got EOF from 127.12.112.193:37471 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":80,"threads_started":1}
Aug 07 22:48:17 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:17 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:17.243353 22293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:17.237535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:35053)
0807 22:48:17.237961 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:17.237977 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:17.238122 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:17.238422 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:17.238425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:17.238607 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:17.238711 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:17.238716 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.239493 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.239497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:17.240072 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:17.240080 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.240586 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.240590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:17.240668 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:17.241149 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:17.241160 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:17.243238 (+ 2078us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":84,"threads_started":1}
W20260807 22:48:17.243517 22292 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:17.237575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:35053 (local address 127.12.112.254:42577)
0807 22:48:17.237724 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:17.237728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:17.238064 (+ 336us) server_negotiation.cc:407] Connection header received
0807 22:48:17.238234 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:17.238239 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:17.238290 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:17.238386 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:17.238816 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.239346 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.240176 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.240463 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.240542 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:17.243373 (+ 2831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:35053: BlockingRecv error: recv got EOF from 127.12.112.194:35053 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 22:48:17 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:17 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:17.444023 22294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:17.433124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:56243)
0807 22:48:17.433490 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:17.433508 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:17.433626 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:17.433947 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:17.433953 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:17.434240 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:17.434417 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:17.434425 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.435224 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.435227 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:17.435792 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:17.435800 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.436361 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.436364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:17.436428 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:17.441775 (+ 5347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:17.441788 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:17.443846 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":116,"threads_started":1}
W20260807 22:48:17.444080 22292 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:17.433240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:56243 (local address 127.12.112.254:42577)
0807 22:48:17.433395 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:17.433401 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:17.433590 (+ 189us) server_negotiation.cc:407] Connection header received
0807 22:48:17.433733 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:17.433735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:17.433781 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:17.433903 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:17.434534 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.435145 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.435977 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:17.436249 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:17.436348 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:17.443971 (+ 7623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:56243: BlockingRecv error: recv got EOF from 127.12.112.195:56243 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 22:48:18 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:18 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:18.065961 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:18.060402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:58807)
0807 22:48:18.060702 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:18.060735 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:18.060859 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:18.061152 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:18.061155 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:18.061433 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:18.061572 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:18.061586 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.062408 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.062411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:18.062974 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:18.062982 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.063422 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.063425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:18.063489 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:18.063982 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:18.063993 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:18.065844 (+ 1851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":88,"threads_started":1}
W20260807 22:48:18.066108 22296 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:18.060585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:58807 (local address 127.12.112.254:42577)
0807 22:48:18.060835 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:18.060840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:18.060855 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:48:18.060939 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:18.060942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:18.061002 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:18.061095 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:18.061699 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.062240 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.063087 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.063314 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.063390 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:18.065975 (+ 2585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:58807: BlockingRecv error: recv got EOF from 127.12.112.193:58807 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":72,"threads_started":1}
Aug 07 22:48:18 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:18 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:18.249742 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:18.244099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:54797)
0807 22:48:18.244393 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:18.244408 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:18.244512 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:18.244730 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:18.244732 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:18.245002 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:18.245143 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:18.245150 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.246194 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.246202 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:18.246849 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:18.246858 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.247256 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.247259 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:18.247325 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:18.247810 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:18.247821 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:18.249627 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":98,"threads_started":1}
W20260807 22:48:18.249936 22296 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:18.244147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:54797 (local address 127.12.112.254:42577)
0807 22:48:18.244299 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:18.244304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:18.244479 (+ 175us) server_negotiation.cc:407] Connection header received
0807 22:48:18.244579 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:18.244581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:18.244627 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:18.244694 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:18.245279 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.246087 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.246950 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.247165 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.247240 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:18.249766 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:54797: BlockingRecv error: recv got EOF from 127.12.112.194:54797 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 22:48:18 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:18 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:18.450670 22298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:18.444812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:43077)
0807 22:48:18.445111 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:18.445124 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:18.445294 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:18.445581 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:18.445585 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:18.445806 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:18.445911 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:18.445917 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.446788 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.446793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:18.447376 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:18.447385 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.447866 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.447869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:18.447958 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:18.448552 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:18.448565 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:18.450554 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":87,"threads_started":1}
W20260807 22:48:18.450843 22296 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:18.444868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:43077 (local address 127.12.112.254:42577)
0807 22:48:18.445060 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:18.445065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:18.445201 (+ 136us) server_negotiation.cc:407] Connection header received
0807 22:48:18.445405 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:18.445409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:18.445469 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:18.445555 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:18.446037 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.446667 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.447499 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:18.447738 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:18.447861 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:18.450683 (+ 2822us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:43077: BlockingRecv error: recv got EOF from 127.12.112.195:43077 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 07 22:48:19 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:19 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:19.072485 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:19.066852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:55855)
0807 22:48:19.067157 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:19.067173 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:19.067292 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:19.067548 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:19.067551 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:19.067731 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:19.067833 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:19.067838 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.068611 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.068613 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:19.069171 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:19.069179 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.069625 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.069627 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:19.069691 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:19.070215 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:19.070227 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:19.072307 (+ 2080us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":73,"threads_started":1}
W20260807 22:48:19.072563 22300 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:19.066903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:55855 (local address 127.12.112.254:42577)
0807 22:48:19.067195 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:19.067198 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:19.067242 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:48:19.067379 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:19.067381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:19.067428 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:19.067511 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:19.067941 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.068516 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.069296 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.069524 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.069604 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:19.072432 (+ 2828us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:55855: BlockingRecv error: recv got EOF from 127.12.112.193:55855 (error 108)
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":102,"threads_started":1}
Aug 07 22:48:19 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:19 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:19.256206 22301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:19.250555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:35151)
0807 22:48:19.250845 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:19.250859 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:19.250961 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:19.251194 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:19.251196 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:19.251405 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:19.251530 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:19.251536 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.252337 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.252340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:19.252918 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:19.252926 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.253404 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.253407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:19.253477 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:19.253981 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:19.253992 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:19.256014 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":105,"threads_started":1}
W20260807 22:48:19.256251 22300 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:19.250623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:35151 (local address 127.12.112.254:42577)
0807 22:48:19.250772 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:19.250778 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:19.250932 (+ 154us) server_negotiation.cc:407] Connection header received
0807 22:48:19.251029 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:19.251032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:19.251076 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:19.251140 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:19.251663 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.252210 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.253051 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.253281 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.253378 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:19.256147 (+ 2769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:35151: BlockingRecv error: recv got EOF from 127.12.112.194:35151 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 22:48:19 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:19 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:19.457401 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:19.451377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:50405)
0807 22:48:19.451668 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:19.451682 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:19.451796 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:19.452032 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:19.452034 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:19.452216 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:19.452316 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:19.452321 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.453037 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.453040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:19.453702 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:19.453716 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.454410 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.454416 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:19.454536 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:19.455110 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:19.455121 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:19.457224 (+ 2103us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":76,"threads_started":1}
W20260807 22:48:19.457518 22300 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:19.451525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:50405 (local address 127.12.112.254:42577)
0807 22:48:19.451683 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:19.451687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:19.451754 (+ 67us) server_negotiation.cc:407] Connection header received
0807 22:48:19.451876 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:19.451878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:19.451924 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:19.451989 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:19.452414 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.452935 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.453833 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:19.454246 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:19.454394 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:19.457399 (+ 3005us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:50405: BlockingRecv error: recv got EOF from 127.12.112.195:50405 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 07 22:48:20 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:20 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:20.078668 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:20.073337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:50587)
0807 22:48:20.073616 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:20.073630 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:20.073716 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:20.074011 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:20.074013 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:20.074193 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:20.074295 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:20.074322 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.075053 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.075055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:20.075620 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:20.075627 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.076058 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.076061 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:20.076124 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:20.076631 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:20.076643 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:20.078536 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":104,"threads_started":1}
W20260807 22:48:20.079010 22304 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:20.073430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:50587 (local address 127.12.112.254:42577)
0807 22:48:20.073675 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:20.073678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:20.073692 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:48:20.073830 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:20.073833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:20.073890 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:20.073976 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:20.074411 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.074960 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.075725 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.075959 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.076038 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:20.078835 (+ 2797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:50587: BlockingRecv error: recv got EOF from 127.12.112.193:50587 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":82,"threads_started":1}
Aug 07 22:48:20 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:20 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:20.262807 22305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:20.257046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:39375)
0807 22:48:20.257343 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:20.257357 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:20.257508 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:20.257792 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:20.257795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:20.258024 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:20.258125 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:20.258131 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.259026 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.259031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:20.259611 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:20.259619 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.260103 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.260106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:20.260195 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:20.260758 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:20.260769 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:20.262638 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":106,"threads_started":1}
W20260807 22:48:20.262884 22304 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:20.257134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:39375 (local address 127.12.112.254:42577)
0807 22:48:20.257277 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:20.257280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:20.257481 (+ 201us) server_negotiation.cc:407] Connection header received
0807 22:48:20.257603 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:20.257606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:20.257660 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:20.257757 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:20.258270 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.258910 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.259737 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.259985 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.260099 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:20.262767 (+ 2668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:39375: BlockingRecv error: recv got EOF from 127.12.112.194:39375 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 22:48:20 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:20 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:20.464102 22306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:20.458367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:58999)
0807 22:48:20.458719 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:20.458737 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:20.458859 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:20.459156 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:20.459159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:20.459374 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:20.459468 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:20.459473 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.460262 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.460268 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:20.460835 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:20.460843 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.461329 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.461333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:20.461434 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:20.462008 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:20.462020 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:20.463987 (+ 1967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":126,"threads_started":1}
W20260807 22:48:20.464303 22304 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:20.458580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:58999 (local address 127.12.112.254:42577)
0807 22:48:20.458728 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:20.458735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:20.458801 (+ 66us) server_negotiation.cc:407] Connection header received
0807 22:48:20.458983 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:20.458986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:20.459043 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:20.459132 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:20.459607 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.460152 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.460968 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:20.461206 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:20.461315 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:20.464131 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:58999: BlockingRecv error: recv got EOF from 127.12.112.195:58999 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 22:48:21 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:21 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:21.085143 22307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:21.079555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:56337)
0807 22:48:21.079832 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:21.079845 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:21.079942 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:21.080202 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:21.080204 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:21.080405 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:21.080505 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:21.080510 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.081260 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.081262 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:21.081849 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:21.081857 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.082269 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.082272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:21.082409 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:21.082927 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:21.082941 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:21.084970 (+ 2029us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":91,"threads_started":1}
W20260807 22:48:21.085212 22308 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:21.079603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:56337 (local address 127.12.112.254:42577)
0807 22:48:21.079855 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:21.079858 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:21.079921 (+ 63us) server_negotiation.cc:407] Connection header received
0807 22:48:21.080024 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:21.080026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:21.080071 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:21.080161 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:21.080621 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.081171 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.081953 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.082174 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.082248 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:21.085089 (+ 2841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:56337: BlockingRecv error: recv got EOF from 127.12.112.193:56337 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":91,"threads_started":1}
Aug 07 22:48:21 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:21 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:21.270192 22309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:21.263912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:48483)
0807 22:48:21.264236 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:21.264250 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:21.264355 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:21.264588 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:21.264590 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:21.264790 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:21.264893 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:21.264898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.265869 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.265871 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:21.266515 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:21.266524 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.267000 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.267003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:21.267097 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:21.267750 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:21.267762 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:21.270075 (+ 2313us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":122,"threads_started":1}
W20260807 22:48:21.270349 22308 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:21.263973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:48483 (local address 127.12.112.254:42577)
0807 22:48:21.264147 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:21.264153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:21.264323 (+ 170us) server_negotiation.cc:407] Connection header received
0807 22:48:21.264433 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:21.264435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:21.264482 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:21.264551 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:21.265046 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.265763 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.266631 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.266866 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.266953 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:21.270210 (+ 3257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:48483: BlockingRecv error: recv got EOF from 127.12.112.194:48483 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 07 22:48:21 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:21 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:21.470798 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:21.464918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:54391)
0807 22:48:21.465204 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:21.465223 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:21.465427 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:21.465805 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:21.465811 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:21.466026 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:21.466127 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:21.466133 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.466902 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.466906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:21.467561 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:21.467570 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.468069 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.468073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:21.468152 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:21.468715 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:21.468727 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:21.470667 (+ 1940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":90,"threads_started":1}
W20260807 22:48:21.470942 22308 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:21.464979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:54391 (local address 127.12.112.254:42577)
0807 22:48:21.465114 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:21.465119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:21.465376 (+ 257us) server_negotiation.cc:407] Connection header received
0807 22:48:21.465538 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:21.465542 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:21.465600 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:21.465685 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:21.466235 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.466776 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.467682 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:21.467922 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:21.468028 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:21.470808 (+ 2780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:54391: BlockingRecv error: recv got EOF from 127.12.112.195:54391 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 22:48:22 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:22 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:22.091828 22312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:22.085930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:42773)
0807 22:48:22.086234 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:22.086248 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:22.086432 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:22.086691 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:22.086693 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:22.086875 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:22.086974 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:22.086979 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.087701 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.087704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:22.088270 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:22.088278 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.088760 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.088762 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:22.088825 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:22.089402 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:22.089415 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:22.091652 (+ 2237us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":83,"threads_started":1}
W20260807 22:48:22.092016 22313 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:22.086038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:42773 (local address 127.12.112.254:42577)
0807 22:48:22.086330 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:22.086334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:22.086347 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:48:22.086527 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:22.086529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:22.086575 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:22.086652 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:22.087075 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.087610 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.088411 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.088653 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.088742 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:22.091785 (+ 3043us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:42773: BlockingRecv error: recv got EOF from 127.12.112.193:42773 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":80,"threads_started":1}
Aug 07 22:48:22 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:22 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:22.277226 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:22.271074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:50155)
0807 22:48:22.271391 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:22.271406 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:22.271513 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:22.271786 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:22.271789 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:22.271986 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:22.272089 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:22.272094 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.272836 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.272839 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:22.273460 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:22.273469 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.273918 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.273927 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:22.274006 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:22.275067 (+ 1061us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:22.275079 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:22.277051 (+ 1972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":78,"threads_started":1}
W20260807 22:48:22.277285 22313 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:22.271233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:50155 (local address 127.12.112.254:42577)
0807 22:48:22.271418 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:22.271421 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:22.271476 (+ 55us) server_negotiation.cc:407] Connection header received
0807 22:48:22.271592 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:22.271594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:22.271638 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:22.271711 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:22.272191 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.272719 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.273571 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.273792 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.273877 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:22.277174 (+ 3297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:50155: BlockingRecv error: recv got EOF from 127.12.112.194:50155 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 07 22:48:22 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:22 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:22.480892 22315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:22.471702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:34647)
0807 22:48:22.471987 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:22.472000 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:22.472102 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:22.472364 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:22.472366 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:22.472552 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:22.472652 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:22.472657 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.473452 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.473455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:22.474145 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:22.474156 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.474714 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.474717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:22.474820 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:22.478829 (+ 4009us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:22.478843 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:22.480755 (+ 1912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":103,"threads_started":1}
W20260807 22:48:22.481084 22313 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:22.471855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:34647 (local address 127.12.112.254:42577)
0807 22:48:22.472000 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:22.472004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:22.472074 (+ 70us) server_negotiation.cc:407] Connection header received
0807 22:48:22.472189 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:22.472191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:22.472245 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:22.472326 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:22.472758 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.473316 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.474336 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:22.474572 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:22.474705 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:22.480917 (+ 6212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:34647: BlockingRecv error: recv got EOF from 127.12.112.195:34647 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 22:48:23 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:23 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:23.098634 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:23.092670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:45749)
0807 22:48:23.092974 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:23.092988 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:23.093090 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:23.093386 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:23.093389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:23.093576 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:23.093678 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:23.093683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.094570 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.094573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:23.095142 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:23.095151 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.095625 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.095628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:23.095693 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:23.096372 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:23.096390 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:23.098511 (+ 2121us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":96,"threads_started":1}
W20260807 22:48:23.098802 22318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:23.092738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:45749 (local address 127.12.112.254:42577)
0807 22:48:23.092991 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:23.092995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:23.093062 (+ 67us) server_negotiation.cc:407] Connection header received
0807 22:48:23.093167 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:23.093170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:23.093215 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:23.093300 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:23.093876 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.094456 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.095250 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.095509 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.095616 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:23.098658 (+ 3042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:45749: BlockingRecv error: recv got EOF from 127.12.112.193:45749 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":75,"threads_started":1}
Aug 07 22:48:23 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:23 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:23.283818 22319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:23.278144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:39289)
0807 22:48:23.278478 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:23.278491 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:23.278590 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:23.278848 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:23.278851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:23.279052 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:23.279156 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:23.279162 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.279919 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.279923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:23.280530 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:23.280538 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.280957 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.280959 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:23.281025 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:23.281607 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:23.281619 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:23.283691 (+ 2072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":89,"threads_started":1}
W20260807 22:48:23.283944 22318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:23.278291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:39289 (local address 127.12.112.254:42577)
0807 22:48:23.278472 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:23.278475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:23.278545 (+ 70us) server_negotiation.cc:407] Connection header received
0807 22:48:23.278657 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:23.278659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:23.278701 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:23.278770 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:23.279271 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.279804 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.280639 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.280854 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.280928 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:23.283824 (+ 2896us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:39289: BlockingRecv error: recv got EOF from 127.12.112.194:39289 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 07 22:48:23 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:23 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:23.487123 22320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:23.481648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:58411)
0807 22:48:23.481940 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:23.481953 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:23.482052 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:23.482443 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:23.482448 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:23.482641 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:23.482744 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:23.482750 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.483479 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.483481 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:23.484037 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:23.484044 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.484460 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.484463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:23.484528 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:23.485101 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:23.485113 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:23.487005 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":118,"threads_started":1}
W20260807 22:48:23.487253 22318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:23.481731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:58411 (local address 127.12.112.254:42577)
0807 22:48:23.481869 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:23.481873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:23.482030 (+ 157us) server_negotiation.cc:407] Connection header received
0807 22:48:23.482132 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:23.482134 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:23.482180 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:23.482246 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:23.482852 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.483383 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.484139 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:23.484353 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:23.484427 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:23.487130 (+ 2703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:58411: BlockingRecv error: recv got EOF from 127.12.112.195:58411 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 22:48:24 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:24 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:24.104782 22321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:24.099384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:44163)
0807 22:48:24.099671 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:24.099693 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:24.099817 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:24.100078 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:24.100080 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:24.100263 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:24.100364 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:24.100369 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.101159 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.101161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:24.101713 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:24.101721 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.102178 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.102180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:24.102242 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:24.102790 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:24.102802 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:24.104664 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":73,"threads_started":1}
W20260807 22:48:24.104992 22322 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:24.099510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:44163 (local address 127.12.112.254:42577)
0807 22:48:24.099865 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:24.099869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:24.099882 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:48:24.099917 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:24.099919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:24.099960 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:24.100035 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:24.100496 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.101061 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.101827 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.102072 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.102155 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:24.104803 (+ 2648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:44163: BlockingRecv error: recv got EOF from 127.12.112.193:44163 (error 108)
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":112,"threads_started":1}
Aug 07 22:48:24 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:24 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:24.289845 22323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:24.284692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:41701)
0807 22:48:24.284982 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:24.284996 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:24.285095 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:24.285338 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:24.285340 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:24.285520 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:24.285617 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:24.285622 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.286329 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.286331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:24.286903 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:24.286911 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.287306 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.287308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:24.287374 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:24.287847 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:24.287865 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:24.289721 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":91,"threads_started":1}
W20260807 22:48:24.290046 22322 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:24.284788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:41701 (local address 127.12.112.254:42577)
0807 22:48:24.284970 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:24.284974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:24.285063 (+ 89us) server_negotiation.cc:407] Connection header received
0807 22:48:24.285179 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:24.285181 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:24.285224 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:24.285300 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:24.285710 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.286226 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.286996 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.287212 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.287287 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:24.289895 (+ 2608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:41701: BlockingRecv error: recv got EOF from 127.12.112.194:41701 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 07 22:48:24 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:24 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.195@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:24.493340 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:24.488035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.195:36517)
0807 22:48:24.488317 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:24.488331 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:24.488433 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:24.488650 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:24.488652 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:24.488836 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:24.488945 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:24.488950 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.489688 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.489691 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:24.490249 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:24.490256 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.490717 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.490719 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:24.490782 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:24.491286 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:24.491298 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:24.493222 (+ 1924us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":102,"threads_started":1}
W20260807 22:48:24.493531 22322 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:24.488082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:36517 (local address 127.12.112.254:42577)
0807 22:48:24.488223 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:24.488227 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:24.488405 (+ 178us) server_negotiation.cc:407] Connection header received
0807 22:48:24.488499 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:24.488501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:24.488546 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:24.488611 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:24.489047 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.489587 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.490411 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:24.490623 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:24.490697 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:24.493366 (+ 2669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.195:36517: BlockingRecv error: recv got EOF from 127.12.112.195:36517 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 22:48:25 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:25 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.193@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:25.111233 22325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:25.105719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.193:33095)
0807 22:48:25.105992 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:25.106014 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:25.106098 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:25.106397 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:25.106399 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:25.106635 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:25.106755 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:25.106761 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.107738 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.107741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:25.108313 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:25.108322 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.108735 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.108738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:25.108801 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:25.109280 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:25.109292 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:25.111118 (+ 1826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":72,"threads_started":1}
W20260807 22:48:25.111434 22326 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:25.105820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:33095 (local address 127.12.112.254:42577)
0807 22:48:25.106076 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:25.106080 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:25.106094 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:48:25.106166 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:25.106169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:25.106210 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:25.106355 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:25.106874 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.107604 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.108418 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.108638 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.108713 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:25.111250 (+ 2537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.193:33095: BlockingRecv error: recv got EOF from 127.12.112.193:33095 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":94,"threads_started":1}
Aug 07 22:48:25 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:48:25 dist-test-slave-tm1g krb5kdc[21210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.112.194@KRBTEST.COM for oryx/127.12.112.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:48:25.296692 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:25.290931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:42577 (local address 127.12.112.194:43205)
0807 22:48:25.291219 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:25.291233 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:25.291346 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:25.291653 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:25.291656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:25.291856 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:25.291992 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:25.292000 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.293021 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.293024 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:25.293593 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:25.293601 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.294005 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.294008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:25.294073 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:25.294580 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:25.294591 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:25.296501 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.112.254:42577: Server oryx/127.12.112.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":107,"threads_started":1}
W20260807 22:48:25.296768 22326 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:25.291002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:43205 (local address 127.12.112.254:42577)
0807 22:48:25.291165 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:25.291169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:25.291328 (+ 159us) server_negotiation.cc:407] Connection header received
0807 22:48:25.291436 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:25.291440 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:25.291502 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:25.291590 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:25.292119 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.292922 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.293691 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.293912 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.293985 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:25.296637 (+ 2652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.112.194:43205: BlockingRecv error: recv got EOF from 127.12.112.194:43205 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 22:48:25.382277 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 21815
I20260807 22:48:25.389632 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 21984
I20260807 22:48:25.395843 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 22123
I20260807 22:48:25.401782 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 21739
2026-08-07T22:48:25Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18092 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T22:48:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:48:25Z Disabled control of system clock
I20260807 22:48:25.433904 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33187
--webserver_interface=127.12.112.254
--webserver_port=0
--builtin_ntp_servers=127.12.112.212:37155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:33187
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 22:48:25.542107 22331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:25.542423 22331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:25.542517 22331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:25.546478 22331 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:48:25.546557 22331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:25.546590 22331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:25.546626 22331 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:48:25.546658 22331 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:48:25.551412 22331 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:37155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:33187
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:25.552415 22331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:25.553747 22331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:25.562072 22339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:25.562222 22331 server_base.cc:1034] running on GCE node
W20260807 22:48:25.562098 22342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:25.562081 22340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:25.562901 22331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:25.563930 22331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:25.565150 22331 hybrid_clock.cc:648] HybridClock initialized: now 1786142905565123 us; error 37 us; skew 500 ppm
I20260807 22:48:25.567015 22331 webserver.cc:460] Webserver started at http://127.12.112.254:38963/ using document root <none> and password file <none>
I20260807 22:48:25.567579 22331 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:25.567669 22331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:25.567901 22331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:25.569907 22331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "abacca8f75354d27ae15867a67cc786b"
format_stamp: "Formatted at 2026-08-07 22:48:25 on dist-test-slave-tm1g"
server_key: "e51c3be4237dd313bbe86e699ee7ba39"
server_key_iv: "3295af442399715e1435485fc1772edc"
server_key_version: "encryptionkey@0"
I20260807 22:48:25.570544 22331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "abacca8f75354d27ae15867a67cc786b"
format_stamp: "Formatted at 2026-08-07 22:48:25 on dist-test-slave-tm1g"
server_key: "e51c3be4237dd313bbe86e699ee7ba39"
server_key_iv: "3295af442399715e1435485fc1772edc"
server_key_version: "encryptionkey@0"
I20260807 22:48:25.574745 22331 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:48:25.577392 22349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:25.578671 22331 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:48:25.578809 22331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "abacca8f75354d27ae15867a67cc786b"
format_stamp: "Formatted at 2026-08-07 22:48:25 on dist-test-slave-tm1g"
server_key: "e51c3be4237dd313bbe86e699ee7ba39"
server_key_iv: "3295af442399715e1435485fc1772edc"
server_key_version: "encryptionkey@0"
I20260807 22:48:25.578919 22331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:25.605666 22331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:25.606383 22331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:25.606603 22331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:25.613744 22331 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:33187
I20260807 22:48:25.613761 22404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:33187 every 8 connection(s)
I20260807 22:48:25.614756 22331 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:48:25.617766 22405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:25.619498 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 22331
I20260807 22:48:25.619629 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:48:25.619913 12739 external_mini_cluster.cc:1428] Setting key cf3611ce0957f93991c24443b4cd9013
I20260807 22:48:25.623525 22405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b: Bootstrap starting.
I20260807 22:48:25.625669 22405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:25.626459 22405 log.cc:824] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:25.628417 22405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b: No bootstrap required, opened a new log
I20260807 22:48:25.629015 22408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:25.621247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47954 (local address 127.12.112.254:33187)
0807 22:48:25.621981 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:25.621996 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:25.622031 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:48:25.622788 (+ 757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:25.622807 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:25.623184 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:25.623519 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:25.623996 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.624945 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.625834 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.626342 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.626524 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:25.627336 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:25.627341 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:25.627352 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:48:25.627717 (+ 365us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:25.627769 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:48:25.627788 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:25.627908 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:25.628011 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 22:48:25.628257 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":135,"threads_started":1}
I20260807 22:48:25.632449 22405 raft_consensus.cc:348] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abacca8f75354d27ae15867a67cc786b" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33187 } }
I20260807 22:48:25.632682 22405 raft_consensus.cc:374] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:25.632766 22405 raft_consensus.cc:729] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abacca8f75354d27ae15867a67cc786b, State: Initialized, Role: FOLLOWER
I20260807 22:48:25.633163 22405 consensus_queue.cc:260] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abacca8f75354d27ae15867a67cc786b" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33187 } }
I20260807 22:48:25.633314 22405 raft_consensus.cc:388] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:48:25.633402 22405 raft_consensus.cc:482] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:48:25.633504 22405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:25.634605 22405 raft_consensus.cc:504] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abacca8f75354d27ae15867a67cc786b" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33187 } }
I20260807 22:48:25.634930 22405 leader_election.cc:302] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abacca8f75354d27ae15867a67cc786b; no voters:
I20260807 22:48:25.635236 22405 leader_election.cc:288] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:48:25.635327 22410 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:25.635610 22410 raft_consensus.cc:686] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [term 1 LEADER]: Becoming Leader. State: Replica: abacca8f75354d27ae15867a67cc786b, State: Running, Role: LEADER
I20260807 22:48:25.635934 22410 consensus_queue.cc:237] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abacca8f75354d27ae15867a67cc786b" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33187 } }
I20260807 22:48:25.636361 22405 sys_catalog.cc:564] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:48:25.637598 22411 sys_catalog.cc:455] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abacca8f75354d27ae15867a67cc786b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abacca8f75354d27ae15867a67cc786b" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33187 } } }
I20260807 22:48:25.637609 22412 sys_catalog.cc:455] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [sys.catalog]: SysCatalogTable state changed. Reason: New leader abacca8f75354d27ae15867a67cc786b. Latest consensus state: current_term: 1 leader_uuid: "abacca8f75354d27ae15867a67cc786b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abacca8f75354d27ae15867a67cc786b" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33187 } } }
I20260807 22:48:25.637822 22411 sys_catalog.cc:458] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:25.637851 22412 sys_catalog.cc:458] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:25.638633 22420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:48:25.641187 22420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:48:25.646106 22420 catalog_manager.cc:1347] Generated new cluster ID: 0d66b878105a475e87fe4e1d75492a6d
I20260807 22:48:25.646176 22420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:48:25.655906 22420 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:48:25.656705 22420 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:48:25.671213 22420 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abacca8f75354d27ae15867a67cc786b: Generated new TSK 0
I20260807 22:48:25.671886 22420 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:48:25.681528 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33187
--builtin_ntp_servers=127.12.112.212:37155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 22:48:25.807447 22429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:25.807693 22429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:25.807727 22429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:25.811631 22429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:25.811681 22429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:25.811731 22429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:48:25.816200 22429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:37155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:25.817163 22429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:25.818523 22429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:25.827965 22437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:25.827965 22434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:25.828168 22429 server_base.cc:1034] running on GCE node
W20260807 22:48:25.827999 22435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:25.828776 22429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:25.829420 22429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:25.830606 22429 hybrid_clock.cc:648] HybridClock initialized: now 1786142905830591 us; error 24 us; skew 500 ppm
I20260807 22:48:25.832369 22429 webserver.cc:460] Webserver started at http://127.12.112.193:45541/ using document root <none> and password file <none>
I20260807 22:48:25.832926 22429 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:25.832986 22429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:25.833220 22429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:25.835248 22429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "44aa7db99e604fe5976795f3398aff68"
format_stamp: "Formatted at 2026-08-07 22:48:25 on dist-test-slave-tm1g"
server_key: "218bec3c83e952aabae62d65ab752e09"
server_key_iv: "5df37e19b98321cbfe8b31ff43a3bd91"
server_key_version: "encryptionkey@0"
I20260807 22:48:25.835793 22429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "44aa7db99e604fe5976795f3398aff68"
format_stamp: "Formatted at 2026-08-07 22:48:25 on dist-test-slave-tm1g"
server_key: "218bec3c83e952aabae62d65ab752e09"
server_key_iv: "5df37e19b98321cbfe8b31ff43a3bd91"
server_key_version: "encryptionkey@0"
I20260807 22:48:25.839466 22429 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:48:25.841729 22443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:25.842954 22429 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:48:25.843088 22429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "44aa7db99e604fe5976795f3398aff68"
format_stamp: "Formatted at 2026-08-07 22:48:25 on dist-test-slave-tm1g"
server_key: "218bec3c83e952aabae62d65ab752e09"
server_key_iv: "5df37e19b98321cbfe8b31ff43a3bd91"
server_key_version: "encryptionkey@0"
I20260807 22:48:25.843199 22429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:25.877696 22429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:25.878526 22429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:25.878720 22429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:25.879360 22429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:25.880308 22429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:25.880378 22429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:25.880445 22429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:25.880496 22429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:25.889252 22429 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:41719
I20260807 22:48:25.889307 22562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:41719 every 8 connection(s)
I20260807 22:48:25.890123 22429 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:48:25.899166 22408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:25.891818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:57281 (local address 127.12.112.254:33187)
0807 22:48:25.891973 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:25.891977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:25.893056 (+ 1079us) server_negotiation.cc:407] Connection header received
0807 22:48:25.894537 (+ 1481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:25.894540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:25.894588 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:25.894661 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:25.895506 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.896173 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.897295 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.897510 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.897592 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:25.898680 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:25.898683 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:25.898685 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:48:25.898696 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:25.898714 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:48:25.898721 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:25.898781 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:25.898949 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 22:48:25.899012 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 22:48:25.899423 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 22429
I20260807 22:48:25.899569 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:48:25.899879 12739 external_mini_cluster.cc:1428] Setting key 0ba1c616a9c3788090cc074f815f0423
I20260807 22:48:25.900025 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:25.892202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33187 (local address 127.12.112.193:57281)
0807 22:48:25.892918 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:25.892957 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:25.894172 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:25.894814 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:25.894820 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:25.894899 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:25.895363 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:25.895376 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.896298 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.896301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:25.897176 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:25.897184 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:25.897639 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:25.897642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:25.897787 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:25.898447 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:48:25.898449 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:25.898487 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:48:25.898546 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:25.898795 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:25.898801 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:25.898805 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:48:25.898896 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 22:48:25.899108 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":118,"threads_started":1}
I20260807 22:48:25.901187 22563 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33187
I20260807 22:48:25.901453 22563 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:25.901953 22563 heartbeater.cc:511] Master 127.12.112.254:33187 requested a full tablet report, sending...
I20260807 22:48:25.902115 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33187
--builtin_ntp_servers=127.12.112.212:37155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 22:48:25.903385 22367 ts_manager.cc:194] Registered new tserver with Master: 44aa7db99e604fe5976795f3398aff68 (127.12.112.193:41719)
I20260807 22:48:25.904989 22367 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.193:57281
W20260807 22:48:26.013203 22567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:26.013500 22567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:26.013566 22567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:26.017529 22567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:26.017608 22567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:26.017695 22567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:48:26.022348 22567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:37155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:26.023378 22567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:26.024765 22567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:26.034142 22573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:26.034155 22576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:26.034161 22574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:26.034364 22567 server_base.cc:1034] running on GCE node
I20260807 22:48:26.034829 22567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:26.035462 22567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:26.036646 22567 hybrid_clock.cc:648] HybridClock initialized: now 1786142906036620 us; error 37 us; skew 500 ppm
I20260807 22:48:26.038499 22567 webserver.cc:460] Webserver started at http://127.12.112.194:41649/ using document root <none> and password file <none>
I20260807 22:48:26.039068 22567 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:26.039165 22567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:26.039400 22567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:26.041399 22567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "2ff029d5c4d9409c9080841de3b6568a"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "47fdb6dfd209f119b5105d9563995336"
server_key_iv: "b11e22eb1c366169dec836d7376e53fe"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.041968 22567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "2ff029d5c4d9409c9080841de3b6568a"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "47fdb6dfd209f119b5105d9563995336"
server_key_iv: "b11e22eb1c366169dec836d7376e53fe"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.045536 22567 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.001s
I20260807 22:48:26.048063 22582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.049225 22567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:48:26.049360 22567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "2ff029d5c4d9409c9080841de3b6568a"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "47fdb6dfd209f119b5105d9563995336"
server_key_iv: "b11e22eb1c366169dec836d7376e53fe"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.049472 22567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:26.070492 22567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:26.071180 22567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:26.071393 22567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:26.071977 22567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:26.072916 22567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:26.072988 22567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.073060 22567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:26.073103 22567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.082034 22567 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:44719
I20260807 22:48:26.082062 22700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:44719 every 8 connection(s)
I20260807 22:48:26.083005 22567 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:48:26.089277 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 22567
I20260807 22:48:26.089383 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:48:26.089696 12739 external_mini_cluster.cc:1428] Setting key 6dd79cf5f823db339f3a77bf49b3791c
I20260807 22:48:26.091682 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33187
--builtin_ntp_servers=127.12.112.212:37155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 22:48:26.092707 22408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:26.084815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:58745 (local address 127.12.112.254:33187)
0807 22:48:26.084984 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:26.084989 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:26.086054 (+ 1065us) server_negotiation.cc:407] Connection header received
0807 22:48:26.087429 (+ 1375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:26.087432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:26.087480 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:26.087555 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:26.088464 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:26.089071 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:26.090581 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:26.090839 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:26.090963 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:26.092088 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:26.092095 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:26.092101 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:48:26.092117 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:26.092144 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:48:26.092159 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:26.092242 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:26.092423 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 22:48:26.092496 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 22:48:26.093317 22703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:26.085245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33187 (local address 127.12.112.194:58745)
0807 22:48:26.085900 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:26.085940 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:26.087232 (+ 1292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:26.087745 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:26.087751 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:26.087829 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:26.088312 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:26.088325 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:26.089197 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:26.089200 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:26.090460 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:26.090473 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:26.091033 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:26.091037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:26.091230 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:26.091841 (+ 611us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:48:26.091843 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:26.091880 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:48:26.091943 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:26.092258 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:26.092265 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:26.092270 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:48:26.092395 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 22:48:26.092604 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":111,"threads_started":1}
I20260807 22:48:26.094483 22701 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33187
I20260807 22:48:26.094722 22701 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:26.095223 22701 heartbeater.cc:511] Master 127.12.112.254:33187 requested a full tablet report, sending...
I20260807 22:48:26.096268 22367 ts_manager.cc:194] Registered new tserver with Master: 2ff029d5c4d9409c9080841de3b6568a (127.12.112.194:44719)
I20260807 22:48:26.097157 22367 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.194:58745
W20260807 22:48:26.203148 22705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:26.203403 22705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:26.203441 22705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:26.207338 22705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:26.207384 22705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:26.207435 22705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:48:26.211905 22705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:37155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:26.212872 22705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:26.214159 22705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:48:26.223496 22705 server_base.cc:1034] running on GCE node
W20260807 22:48:26.223496 22711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:26.223532 22713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:26.223719 22710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:26.224077 22705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:26.224714 22705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:26.225899 22705 hybrid_clock.cc:648] HybridClock initialized: now 1786142906225887 us; error 36 us; skew 500 ppm
I20260807 22:48:26.227674 22705 webserver.cc:460] Webserver started at http://127.12.112.195:40843/ using document root <none> and password file <none>
I20260807 22:48:26.228231 22705 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:26.228325 22705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:26.228561 22705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:26.230660 22705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "54f8e2627cc2415e978de913584b1865"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "f4c52b83a16df121d468ca9b5e1e831f"
server_key_iv: "f31a8cf2549cb143d7be3c7658d11959"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.231220 22705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "54f8e2627cc2415e978de913584b1865"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "f4c52b83a16df121d468ca9b5e1e831f"
server_key_iv: "f31a8cf2549cb143d7be3c7658d11959"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.234788 22705 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:48:26.237195 22720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.238428 22705 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:48:26.238555 22705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "54f8e2627cc2415e978de913584b1865"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "f4c52b83a16df121d468ca9b5e1e831f"
server_key_iv: "f31a8cf2549cb143d7be3c7658d11959"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.238667 22705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:26.256187 22705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:26.256835 22705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:26.257030 22705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:26.257598 22705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:26.258556 22705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:26.258626 22705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.258687 22705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:26.258740 22705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.267182 22705 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:43561
I20260807 22:48:26.267212 22839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:43561 every 8 connection(s)
I20260807 22:48:26.268385 22705 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:48:26.268743 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 22705
I20260807 22:48:26.268860 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:48:26.269203 12739 external_mini_cluster.cc:1428] Setting key deef01a98b47db0bfe42e0b17434a935
I20260807 22:48:26.277834 22408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:26.270225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:58959 (local address 127.12.112.254:33187)
0807 22:48:26.270458 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:26.270464 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:26.271675 (+ 1211us) server_negotiation.cc:407] Connection header received
0807 22:48:26.273059 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:26.273063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:26.273121 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:26.273192 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:26.274043 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:26.274670 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:26.275836 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:26.276071 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:26.276179 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:26.277279 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:26.277283 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:26.277286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:48:26.277298 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:26.277324 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:48:26.277336 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:26.277436 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:26.277627 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 22:48:26.277693 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260807 22:48:26.278671 22842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:26.270727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33187 (local address 127.12.112.195:58959)
0807 22:48:26.271532 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:26.271588 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:26.272848 (+ 1260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:26.273353 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:26.273360 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:26.273439 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:26.273906 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:26.273918 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:26.274796 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:26.274800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:26.275711 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:26.275720 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:26.276227 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:26.276232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:26.276393 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:26.277028 (+ 635us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:48:26.277030 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:26.277072 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:48:26.277131 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:26.277441 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:26.277457 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:26.277473 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 22:48:26.277626 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 22:48:26.277904 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":154,"threads_started":1}
I20260807 22:48:26.279707 22840 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33187
I20260807 22:48:26.279950 22840 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:26.280428 22840 heartbeater.cc:511] Master 127.12.112.254:33187 requested a full tablet report, sending...
I20260807 22:48:26.281348 22367 ts_manager.cc:194] Registered new tserver with Master: 54f8e2627cc2415e978de913584b1865 (127.12.112.195:43561)
I20260807 22:48:26.282027 22367 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.195:58959
I20260807 22:48:26.283277 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 22:48:26.285848 22408 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:26.285045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47964 (local address 127.12.112.254:33187)
0807 22:48:26.285206 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:26.285210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:26.285313 (+ 103us) server_negotiation.cc:407] Connection header received
0807 22:48:26.285406 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:26.285408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:26.285443 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:26.285506 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:26.285708 (+ 202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47964: BlockingRecv error: recv got EOF from 127.0.0.1:47964 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 22:48:26.285956 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 22429
I20260807 22:48:26.297405 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 22567
I20260807 22:48:26.303671 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 22705
I20260807 22:48:26.310115 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 22331
2026-08-07T22:48:26Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (906 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T22:48:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:48:26Z Disabled control of system clock
I20260807 22:48:26.340804 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36463
--webserver_interface=127.12.112.254
--webserver_port=0
--builtin_ntp_servers=127.12.112.212:35047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:36463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 22:48:26.449193 22851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:26.449450 22851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:26.449486 22851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:26.453315 22851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:48:26.453365 22851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:26.453382 22851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:26.453397 22851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:48:26.453413 22851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:48:26.457899 22851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:36463
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:26.458858 22851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:26.460152 22851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:26.468389 22856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:26.468420 22857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:26.468389 22859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:26.468521 22851 server_base.cc:1034] running on GCE node
I20260807 22:48:26.469223 22851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:26.470368 22851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:26.471547 22851 hybrid_clock.cc:648] HybridClock initialized: now 1786142906471528 us; error 30 us; skew 500 ppm
I20260807 22:48:26.473316 22851 webserver.cc:460] Webserver started at http://127.12.112.254:35955/ using document root <none> and password file <none>
I20260807 22:48:26.473932 22851 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:26.473997 22851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:26.474225 22851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:26.476454 22851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "fdb13f83d3714ecaba1975f4f1b80566"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "55ba888a6292133966e6690272fd03e3"
server_key_iv: "fe5e2438779379ca8f1707d96112dc4a"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.477021 22851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "fdb13f83d3714ecaba1975f4f1b80566"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "55ba888a6292133966e6690272fd03e3"
server_key_iv: "fe5e2438779379ca8f1707d96112dc4a"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.480599 22851 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:48:26.482861 22866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.484043 22851 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:48:26.484138 22851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "fdb13f83d3714ecaba1975f4f1b80566"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "55ba888a6292133966e6690272fd03e3"
server_key_iv: "fe5e2438779379ca8f1707d96112dc4a"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.484372 22851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:26.488821 22851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:26.489387 22851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:26.489565 22851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:26.496462 22851 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:36463
I20260807 22:48:26.496474 22922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:36463 every 8 connection(s)
I20260807 22:48:26.497354 22851 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:48:26.500557 22923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:26.505893 22923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566: Bootstrap starting.
I20260807 22:48:26.506188 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 22851
I20260807 22:48:26.506340 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:48:26.506635 12739 external_mini_cluster.cc:1428] Setting key 7f90a2a048b839134ccc432858d729c9
I20260807 22:48:26.508682 22923 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:26.509418 22923 log.cc:824] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:26.511658 22923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566: No bootstrap required, opened a new log
I20260807 22:48:26.512176 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:26.507971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52188 (local address 127.12.112.254:36463)
0807 22:48:26.508610 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:26.508625 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:26.508658 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:48:26.509317 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:26.509333 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:26.509720 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:26.510094 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:26.510881 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:26.510885 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:26.510898 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:48:26.510907 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:26.510958 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:48:26.510974 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:26.511059 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:26.511202 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 22:48:26.511474 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":132,"threads_started":1}
I20260807 22:48:26.515506 22923 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb13f83d3714ecaba1975f4f1b80566" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36463 } }
I20260807 22:48:26.515738 22923 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:26.515818 22923 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb13f83d3714ecaba1975f4f1b80566, State: Initialized, Role: FOLLOWER
I20260807 22:48:26.516220 22923 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb13f83d3714ecaba1975f4f1b80566" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36463 } }
I20260807 22:48:26.516368 22923 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:48:26.516460 22923 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:48:26.516578 22923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:26.517436 22923 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb13f83d3714ecaba1975f4f1b80566" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36463 } }
I20260807 22:48:26.517755 22923 leader_election.cc:302] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdb13f83d3714ecaba1975f4f1b80566; no voters:
I20260807 22:48:26.518040 22923 leader_election.cc:288] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:48:26.518146 22928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:26.518436 22928 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [term 1 LEADER]: Becoming Leader. State: Replica: fdb13f83d3714ecaba1975f4f1b80566, State: Running, Role: LEADER
I20260807 22:48:26.519024 22928 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb13f83d3714ecaba1975f4f1b80566" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36463 } }
I20260807 22:48:26.519361 22923 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:48:26.520582 22929 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdb13f83d3714ecaba1975f4f1b80566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb13f83d3714ecaba1975f4f1b80566" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36463 } } }
I20260807 22:48:26.520701 22929 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:26.521068 22930 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdb13f83d3714ecaba1975f4f1b80566. Latest consensus state: current_term: 1 leader_uuid: "fdb13f83d3714ecaba1975f4f1b80566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb13f83d3714ecaba1975f4f1b80566" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36463 } } }
I20260807 22:48:26.521167 22930 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566 [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:26.521355 22939 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:48:26.524132 22939 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:48:26.529058 22939 catalog_manager.cc:1347] Generated new cluster ID: daf051ede4af4ad8949fdfc954e5d47b
I20260807 22:48:26.529119 22939 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:48:26.546277 22939 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:48:26.546641 22939 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:48:26.553586 22939 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdb13f83d3714ecaba1975f4f1b80566: Generated new TSK 0
I20260807 22:48:26.554389 22939 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:48:26.559883 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36463
--builtin_ntp_servers=127.12.112.212:35047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 22:48:26.673211 22949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:26.673482 22949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:26.673563 22949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:26.677925 22949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:26.677994 22949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:26.678076 22949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:48:26.682812 22949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:26.683835 22949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:26.685197 22949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:26.694722 22957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:26.694737 22955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:26.694767 22954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:26.694979 22949 server_base.cc:1034] running on GCE node
I20260807 22:48:26.695441 22949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:26.696094 22949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:26.697269 22949 hybrid_clock.cc:648] HybridClock initialized: now 1786142906697247 us; error 31 us; skew 500 ppm
I20260807 22:48:26.699162 22949 webserver.cc:460] Webserver started at http://127.12.112.193:38821/ using document root <none> and password file <none>
I20260807 22:48:26.699743 22949 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:26.699803 22949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:26.700039 22949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:26.702069 22949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "9a9af97204d1450bac915a0b582a97e4"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "29ebef06994215bc12735d853b82c9fe"
server_key_iv: "e3c6929e2737e120a8662b7496a5042e"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.702684 22949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "9a9af97204d1450bac915a0b582a97e4"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "29ebef06994215bc12735d853b82c9fe"
server_key_iv: "e3c6929e2737e120a8662b7496a5042e"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.706259 22949 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:48:26.708778 22963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.709924 22949 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:48:26.710062 22949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "9a9af97204d1450bac915a0b582a97e4"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "29ebef06994215bc12735d853b82c9fe"
server_key_iv: "e3c6929e2737e120a8662b7496a5042e"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.710177 22949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:26.714741 22949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:26.715333 22949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:26.715528 22949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:26.716063 22949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:26.716964 22949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:26.717036 22949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.717105 22949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:26.717151 22949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.726046 22949 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:42293
I20260807 22:48:26.726114 23081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:42293 every 8 connection(s)
I20260807 22:48:26.727003 22949 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:48:26.732991 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:26.728756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:38575 (local address 127.12.112.254:36463)
0807 22:48:26.728905 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:26.728909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:26.729852 (+ 943us) server_negotiation.cc:407] Connection header received
0807 22:48:26.731210 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:26.731213 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:26.731263 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:26.731374 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:26.732491 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:26.732494 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:26.732497 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:48:26.732510 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:26.732532 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:48:26.732543 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:26.732645 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:26.732794 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 22:48:26.732841 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:48:26.733771 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:26.729072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36463 (local address 127.12.112.193:38575)
0807 22:48:26.729700 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:26.729738 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:26.730996 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:26.731537 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:26.731544 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:26.731628 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:26.732224 (+ 596us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:48:26.732225 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:26.732264 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:48:26.732330 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:26.732638 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:26.732647 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:26.732654 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:48:26.732835 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 22:48:26.733059 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":114,"threads_started":1}
I20260807 22:48:26.734965 23082 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36463
I20260807 22:48:26.735146 23082 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:26.735486 23082 heartbeater.cc:511] Master 127.12.112.254:36463 requested a full tablet report, sending...
I20260807 22:48:26.736574 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 22949
I20260807 22:48:26.736696 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:48:26.736907 22883 ts_manager.cc:194] Registered new tserver with Master: 9a9af97204d1450bac915a0b582a97e4 (127.12.112.193:42293)
I20260807 22:48:26.737018 12739 external_mini_cluster.cc:1428] Setting key 03c1c52cb3683f96385977af11a8e3d4
I20260807 22:48:26.739035 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36463
--builtin_ntp_servers=127.12.112.212:35047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 22:48:26.852109 23085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:26.852367 23085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:26.852407 23085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:26.856451 23085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:26.856506 23085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:26.856561 23085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:48:26.861215 23085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:26.862339 23085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:26.863731 23085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:26.873548 23090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:26.873639 23091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:26.873623 23085 server_base.cc:1034] running on GCE node
W20260807 22:48:26.873548 23093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:26.874339 23085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:26.874989 23085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:26.876142 23085 hybrid_clock.cc:648] HybridClock initialized: now 1786142906876110 us; error 45 us; skew 500 ppm
I20260807 22:48:26.877993 23085 webserver.cc:460] Webserver started at http://127.12.112.194:44587/ using document root <none> and password file <none>
I20260807 22:48:26.878705 23085 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:26.878798 23085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:26.879015 23085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:26.881075 23085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "9129183925094d0e810de00bfa8b57fa"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "16776bd2c05839b7cb4d4a5b61755f0f"
server_key_iv: "bb1288416e66cf5e1c5b3ba09d346707"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.881661 23085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "9129183925094d0e810de00bfa8b57fa"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "16776bd2c05839b7cb4d4a5b61755f0f"
server_key_iv: "bb1288416e66cf5e1c5b3ba09d346707"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.885501 23085 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 22:48:26.888250 23099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.889590 23085 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:48:26.889732 23085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "9129183925094d0e810de00bfa8b57fa"
format_stamp: "Formatted at 2026-08-07 22:48:26 on dist-test-slave-tm1g"
server_key: "16776bd2c05839b7cb4d4a5b61755f0f"
server_key_iv: "bb1288416e66cf5e1c5b3ba09d346707"
server_key_version: "encryptionkey@0"
I20260807 22:48:26.889848 23085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:26.894469 23085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:26.895076 23085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:26.895272 23085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:26.895831 23085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:26.896731 23085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:26.896803 23085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.896868 23085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:26.896903 23085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:26.905929 23085 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:43941
I20260807 22:48:26.905984 23217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:43941 every 8 connection(s)
I20260807 22:48:26.906888 23085 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:48:26.913028 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:26.908678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:56379 (local address 127.12.112.254:36463)
0807 22:48:26.908819 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:26.908823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:26.909825 (+ 1002us) server_negotiation.cc:407] Connection header received
0807 22:48:26.911213 (+ 1388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:26.911217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:26.911264 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:26.911372 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:26.912512 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:26.912515 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:26.912518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:48:26.912532 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:26.912562 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:48:26.912570 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:26.912672 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:26.912805 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 22:48:26.912852 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:48:26.913898 23220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:26.909004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36463 (local address 127.12.112.194:56379)
0807 22:48:26.909675 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:26.909714 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:26.911002 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:26.911540 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:26.911546 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:26.911632 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:26.912244 (+ 612us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:48:26.912246 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:26.912286 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:48:26.912352 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:26.912654 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:26.912663 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:26.912669 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:48:26.912850 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 22:48:26.913107 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":118,"threads_started":1}
I20260807 22:48:26.915177 23218 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36463
I20260807 22:48:26.915417 23218 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:26.915846 23218 heartbeater.cc:511] Master 127.12.112.254:36463 requested a full tablet report, sending...
I20260807 22:48:26.916069 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 23085
I20260807 22:48:26.916188 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:48:26.916581 12739 external_mini_cluster.cc:1428] Setting key 3c5d41f8ea72139de16760714b5f7525
I20260807 22:48:26.917069 22882 ts_manager.cc:194] Registered new tserver with Master: 9129183925094d0e810de00bfa8b57fa (127.12.112.194:43941)
I20260807 22:48:26.918668 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36463
--builtin_ntp_servers=127.12.112.212:35047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 22:48:27.031287 23221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:27.031558 23221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:27.031630 23221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:27.035727 23221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:27.035781 23221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:27.035866 23221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:48:27.040649 23221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:27.041764 23221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:27.043229 23221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:27.052891 23229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:27.052906 23226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:27.053223 23221 server_base.cc:1034] running on GCE node
W20260807 22:48:27.052970 23227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:27.053927 23221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:27.054601 23221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:27.055768 23221 hybrid_clock.cc:648] HybridClock initialized: now 1786142907055748 us; error 36 us; skew 500 ppm
I20260807 22:48:27.062294 23221 webserver.cc:460] Webserver started at http://127.12.112.195:39773/ using document root <none> and password file <none>
I20260807 22:48:27.062924 23221 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:27.062989 23221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:27.063159 23221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:27.065179 23221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "b24c579bfa8b4f06b76c5adb4e29bc27"
format_stamp: "Formatted at 2026-08-07 22:48:27 on dist-test-slave-tm1g"
server_key: "8ee2f24a52951221901baf47c498a708"
server_key_iv: "501439cdf1e8656d4c14ee472b4cb724"
server_key_version: "encryptionkey@0"
I20260807 22:48:27.065824 23221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "b24c579bfa8b4f06b76c5adb4e29bc27"
format_stamp: "Formatted at 2026-08-07 22:48:27 on dist-test-slave-tm1g"
server_key: "8ee2f24a52951221901baf47c498a708"
server_key_iv: "501439cdf1e8656d4c14ee472b4cb724"
server_key_version: "encryptionkey@0"
I20260807 22:48:27.069926 23221 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 22:48:27.072577 23235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:27.073756 23221 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:48:27.073863 23221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "b24c579bfa8b4f06b76c5adb4e29bc27"
format_stamp: "Formatted at 2026-08-07 22:48:27 on dist-test-slave-tm1g"
server_key: "8ee2f24a52951221901baf47c498a708"
server_key_iv: "501439cdf1e8656d4c14ee472b4cb724"
server_key_version: "encryptionkey@0"
I20260807 22:48:27.073957 23221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:27.078768 23221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:27.079370 23221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:27.079551 23221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:27.080093 23221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:27.080983 23221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:27.081053 23221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:27.081118 23221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:27.081171 23221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:27.090651 23221 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:33973
I20260807 22:48:27.090673 23354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:33973 every 8 connection(s)
I20260807 22:48:27.091599 23221 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:48:27.095839 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 23221
I20260807 22:48:27.095961 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:48:27.096294 12739 external_mini_cluster.cc:1428] Setting key a4c8d86078bf380bba31856deeb28d22
I20260807 22:48:27.098246 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:27.093428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:60875 (local address 127.12.112.254:36463)
0807 22:48:27.093614 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:27.093618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:27.094822 (+ 1204us) server_negotiation.cc:407] Connection header received
0807 22:48:27.096405 (+ 1583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:27.096411 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:27.096455 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:27.096529 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:27.097803 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:27.097806 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:27.097809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:48:27.097821 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:27.097846 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:48:27.097856 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:27.097942 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:27.098074 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 22:48:27.098117 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:48:27.099133 23357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:27.093966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36463 (local address 127.12.112.195:60875)
0807 22:48:27.094680 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:27.094720 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:27.096122 (+ 1402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:27.096701 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:27.096708 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:27.096822 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:27.097480 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:48:27.097484 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:27.097545 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:48:27.097640 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:27.097943 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:27.097950 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:27.097954 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:48:27.098084 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 22:48:27.098266 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":111,"threads_started":1}
I20260807 22:48:27.100183 23355 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36463
I20260807 22:48:27.100425 23355 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:27.100822 23355 heartbeater.cc:511] Master 127.12.112.254:36463 requested a full tablet report, sending...
I20260807 22:48:27.101752 22883 ts_manager.cc:194] Registered new tserver with Master: b24c579bfa8b4f06b76c5adb4e29bc27 (127.12.112.195:33973)
I20260807 22:48:27.110414 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 22:48:27.113358 22926 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:48:27.112496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52204 (local address 127.12.112.254:36463)
0807 22:48:27.112658 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:27.112665 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:27.112758 (+ 93us) server_negotiation.cc:407] Connection header received
0807 22:48:27.112841 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:27.112843 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:27.112876 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:27.112941 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:27.113213 (+ 272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52204: BlockingRecv error: recv got EOF from 127.0.0.1:52204 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 22:48:27.113507 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 22949
I20260807 22:48:27.120844 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 23085
I20260807 22:48:27.128557 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 23221
I20260807 22:48:27.137387 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 22851
2026-08-07T22:48:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (828 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:48:27 dist-test-slave-tm1g krb5kdc[23365](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:48:27 dist-test-slave-tm1g krb5kdc[23365](info): set up 2 sockets
Aug 07 22:48:27 dist-test-slave-tm1g krb5kdc[23365](info): commencing operation
krb5kdc: starting...
W20260807 22:48:28.220068 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:48:28 dist-test-slave-tm1g krb5kdc[23365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:48:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:48:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:48:28.358204 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:45911
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:45331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:45911
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:28.472463 23378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:28.472884 23378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:28.472963 23378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:28.477079 23378 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:48:28.477188 23378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:28.477224 23378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:28.477265 23378 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:48:28.477296 23378 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:48:28.482859 23378 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:45331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:45911
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:45911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:28.484002 23378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:28.485057 23378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:28.493721 23387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:28.493721 23385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:28.493759 23384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:28.493947 23378 server_base.cc:1034] running on GCE node
I20260807 22:48:28.494675 23378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:28.495744 23378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:28.496928 23378 hybrid_clock.cc:648] HybridClock initialized: now 1786142908496915 us; error 37 us; skew 500 ppm
Aug 07 22:48:28 dist-test-slave-tm1g krb5kdc[23365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:28.503810 23378 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:48:28.504777 23378 webserver.cc:460] Webserver started at http://127.12.112.254:37145/ using document root <none> and password file <none>
I20260807 22:48:28.505389 23378 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:28.505482 23378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:28.505716 23378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:28.507942 23378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "fb6063124c7a467ca18eb5fa33ff1915"
format_stamp: "Formatted at 2026-08-07 22:48:28 on dist-test-slave-tm1g"
server_key: "b06bdc0c7e896bf382d90ce41a0b4568"
server_key_iv: "72db444f66ba290ff15350b7e3bc9230"
server_key_version: "encryptionkey@0"
I20260807 22:48:28.508528 23378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "fb6063124c7a467ca18eb5fa33ff1915"
format_stamp: "Formatted at 2026-08-07 22:48:28 on dist-test-slave-tm1g"
server_key: "b06bdc0c7e896bf382d90ce41a0b4568"
server_key_iv: "72db444f66ba290ff15350b7e3bc9230"
server_key_version: "encryptionkey@0"
I20260807 22:48:28.512429 23378 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:48:28.514950 23394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:28.516309 23378 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:48:28.516490 23378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "fb6063124c7a467ca18eb5fa33ff1915"
format_stamp: "Formatted at 2026-08-07 22:48:28 on dist-test-slave-tm1g"
server_key: "b06bdc0c7e896bf382d90ce41a0b4568"
server_key_iv: "72db444f66ba290ff15350b7e3bc9230"
server_key_version: "encryptionkey@0"
I20260807 22:48:28.516613 23378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:28.526994 23378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:28.530408 23378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:28.530618 23378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:28.537659 23378 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:45911
I20260807 22:48:28.537985 23454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:45911 every 8 connection(s)
I20260807 22:48:28.538671 23378 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:48:28.541404 23455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:28.545817 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 23378
I20260807 22:48:28.545948 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:48:28.546253 12739 external_mini_cluster.cc:1428] Setting key 9a41f62654a341d9a8f326ce30216f42
I20260807 22:48:28.547438 23455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915: Bootstrap starting.
I20260807 22:48:28.549816 23455 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:28.550645 23455 log.cc:824] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:28.552573 23455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915: No bootstrap required, opened a new log
Aug 07 22:48:28 dist-test-slave-tm1g krb5kdc[23365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:48:28.556455 23455 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6063124c7a467ca18eb5fa33ff1915" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45911 } }
I20260807 22:48:28.556723 23455 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:28.556782 23455 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb6063124c7a467ca18eb5fa33ff1915, State: Initialized, Role: FOLLOWER
I20260807 22:48:28.557238 23455 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6063124c7a467ca18eb5fa33ff1915" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45911 } }
I20260807 22:48:28.557410 23455 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:48:28.557492 23455 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:48:28.557617 23455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:28.558595 23455 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6063124c7a467ca18eb5fa33ff1915" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45911 } }
I20260807 22:48:28.558935 23455 leader_election.cc:302] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb6063124c7a467ca18eb5fa33ff1915; no voters:
I20260807 22:48:28.559270 23455 leader_election.cc:288] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:48:28.559414 23460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:28.559631 23460 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [term 1 LEADER]: Becoming Leader. State: Replica: fb6063124c7a467ca18eb5fa33ff1915, State: Running, Role: LEADER
I20260807 22:48:28.559988 23460 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6063124c7a467ca18eb5fa33ff1915" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45911 } }
I20260807 22:48:28.560604 23455 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:48:28.561153 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:28.547830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40012 (local address 127.12.112.254:45911)
0807 22:48:28.548279 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:28.548294 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:28.548331 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:48:28.548973 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:28.548989 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:28.549301 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:28.549645 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:28.550525 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:28.551759 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:28.552601 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:28.553137 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:28.553307 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:28.555871 (+ 2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:28.555876 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:28.555890 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:28.555919 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:28.557895 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:28.558356 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:28.558366 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:28.558371 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:28.558488 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:28.558803 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:28.558806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:28.558808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:28.559251 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:28.559458 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:28.560037 (+ 579us) server_negotiation.cc:299] Negotiation successful
0807 22:48:28.560351 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":133,"threads_started":1}
I20260807 22:48:28.561975 23461 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb6063124c7a467ca18eb5fa33ff1915" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6063124c7a467ca18eb5fa33ff1915" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45911 } } }
I20260807 22:48:28.562088 23461 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [sys.catalog]: This master's current role is: LEADER
I20260807 22:48:28.563652 23460 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb6063124c7a467ca18eb5fa33ff1915. Latest consensus state: current_term: 1 leader_uuid: "fb6063124c7a467ca18eb5fa33ff1915" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6063124c7a467ca18eb5fa33ff1915" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45911 } } }
I20260807 22:48:28.563766 23460 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915 [sys.catalog]: This master's current role is: LEADER
W20260807 22:48:28.565536 23475 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:48:28.565614 23475 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:48:28.565721 23470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:48:28.566592 23470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:48:28.572710 23470 catalog_manager.cc:1347] Generated new cluster ID: 5398b490254b44da85a21e18e9d66003
I20260807 22:48:28.572786 23470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:48:28.588449 23470 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:48:28.589814 23470 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:48:28.601486 23470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915: Generated new TSK 0
I20260807 22:48:28.602222 23470 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:48:28.637351 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45911
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:45331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:28.753207 23482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:28.753520 23482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:28.753563 23482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:28.757510 23482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:28.757575 23482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:28.757632 23482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:48:28.763361 23482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:45331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:28.764482 23482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:28.765511 23482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:28.775406 23489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:28.775406 23491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:28.775403 23488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:28.775606 23482 server_base.cc:1034] running on GCE node
I20260807 22:48:28.776106 23482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:28.776758 23482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:28.777982 23482 hybrid_clock.cc:648] HybridClock initialized: now 1786142908777932 us; error 63 us; skew 500 ppm
Aug 07 22:48:28 dist-test-slave-tm1g krb5kdc[23365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:28.780839 23482 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:48:28.781723 23482 webserver.cc:460] Webserver started at http://127.12.112.193:43111/ using document root <none> and password file <none>
I20260807 22:48:28.782457 23482 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:28.782558 23482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:28.782801 23482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:28.785007 23482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "032bfceaef8a475dbc4343acf881aff9"
format_stamp: "Formatted at 2026-08-07 22:48:28 on dist-test-slave-tm1g"
server_key: "b34e10fcf874a96473ae0c1f704ea6f6"
server_key_iv: "57a713731f78f0c862dd701a24b2f515"
server_key_version: "encryptionkey@0"
I20260807 22:48:28.785614 23482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "032bfceaef8a475dbc4343acf881aff9"
format_stamp: "Formatted at 2026-08-07 22:48:28 on dist-test-slave-tm1g"
server_key: "b34e10fcf874a96473ae0c1f704ea6f6"
server_key_iv: "57a713731f78f0c862dd701a24b2f515"
server_key_version: "encryptionkey@0"
I20260807 22:48:28.789498 23482 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260807 22:48:28.792207 23498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:28.793586 23482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:48:28.793751 23482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "032bfceaef8a475dbc4343acf881aff9"
format_stamp: "Formatted at 2026-08-07 22:48:28 on dist-test-slave-tm1g"
server_key: "b34e10fcf874a96473ae0c1f704ea6f6"
server_key_iv: "57a713731f78f0c862dd701a24b2f515"
server_key_version: "encryptionkey@0"
I20260807 22:48:28.793905 23482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:28.816008 23482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:28.819248 23482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:28.819416 23482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:28.820094 23482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:28.820982 23482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:28.821033 23482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:28.821076 23482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:28.821092 23482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:28.830353 23482 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:41161
I20260807 22:48:28.830367 23617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:41161 every 8 connection(s)
I20260807 22:48:28.831300 23482 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:48:28.834710 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 23482
I20260807 22:48:28.834812 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:48:28.835096 12739 external_mini_cluster.cc:1428] Setting key 99643ad6d25e834e598426355a648cdc
Aug 07 22:48:28 dist-test-slave-tm1g krb5kdc[23365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:48:28.846617 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:28.833111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:36553 (local address 127.12.112.254:45911)
0807 22:48:28.833257 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:28.833261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:28.834250 (+ 989us) server_negotiation.cc:407] Connection header received
0807 22:48:28.835809 (+ 1559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:28.835813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:28.835867 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:28.835984 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:28.837174 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:28.837719 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:28.839472 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:28.839716 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:28.839823 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:28.842915 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:28.842919 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:28.842921 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:28.842945 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:28.844399 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:28.844941 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:28.844944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:28.844945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:28.845019 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:28.845429 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:28.845432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:28.845434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:28.845628 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:28.845738 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:28.846256 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 22:48:28.846425 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:48:28.847456 23622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:28.833512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:45911 (local address 127.12.112.193:36553)
0807 22:48:28.834002 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:28.834047 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:28.835600 (+ 1553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:28.836158 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:28.836165 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:28.836531 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:28.837024 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:28.837038 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:28.837849 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:28.837853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:28.839310 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:28.839326 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:28.839901 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:28.839906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:28.840150 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:28.840833 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:28.840859 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:28.842714 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:28.844524 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:28.844530 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:28.844546 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:28.844821 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:28.845111 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:28.845115 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:28.845117 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:28.845325 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:28.845736 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:28.845743 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:28.846013 (+ 270us) client_negotiation.cc:769] Sending connection context
0807 22:48:28.846200 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 22:48:28.846586 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":124,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:48:28.848881 23618 heartbeater.cc:347] Connected to a master server at 127.12.112.254:45911
I20260807 22:48:28.849155 23618 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:28.849785 23618 heartbeater.cc:511] Master 127.12.112.254:45911 requested a full tablet report, sending...
I20260807 22:48:28.851475 23416 ts_manager.cc:194] Registered new tserver with Master: 032bfceaef8a475dbc4343acf881aff9 (127.12.112.193:41161)
I20260807 22:48:28.852738 23416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:36553
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:48:28.863415 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45911
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:45331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:28.976423 23625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:28.976697 23625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:28.976742 23625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:28.980772 23625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:28.980835 23625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:28.980895 23625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:48:28.986397 23625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:45331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:28.987465 23625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:28.988473 23625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:28.998216 23631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:28.998207 23633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:28.998204 23630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:28.998468 23625 server_base.cc:1034] running on GCE node
I20260807 22:48:28.998911 23625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:28.999539 23625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:29.000715 23625 hybrid_clock.cc:648] HybridClock initialized: now 1786142909000697 us; error 29 us; skew 500 ppm
Aug 07 22:48:28 dist-test-slave-tm1g krb5kdc[23365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:29.003536 23625 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:48:29.004446 23625 webserver.cc:460] Webserver started at http://127.12.112.194:40007/ using document root <none> and password file <none>
I20260807 22:48:29.005007 23625 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:29.005069 23625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:29.005301 23625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:29.007414 23625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e"
format_stamp: "Formatted at 2026-08-07 22:48:28 on dist-test-slave-tm1g"
server_key: "cfdd5a6a9ad74d6fbd0005956bfc55ac"
server_key_iv: "ec215fd72e01aea7444ec51f4fe9fd6a"
server_key_version: "encryptionkey@0"
I20260807 22:48:29.007982 23625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e"
format_stamp: "Formatted at 2026-08-07 22:48:28 on dist-test-slave-tm1g"
server_key: "cfdd5a6a9ad74d6fbd0005956bfc55ac"
server_key_iv: "ec215fd72e01aea7444ec51f4fe9fd6a"
server_key_version: "encryptionkey@0"
I20260807 22:48:29.011802 23625 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:48:29.014396 23640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:29.015733 23625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:48:29.015836 23625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e"
format_stamp: "Formatted at 2026-08-07 22:48:28 on dist-test-slave-tm1g"
server_key: "cfdd5a6a9ad74d6fbd0005956bfc55ac"
server_key_iv: "ec215fd72e01aea7444ec51f4fe9fd6a"
server_key_version: "encryptionkey@0"
I20260807 22:48:29.015928 23625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:29.032119 23625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:29.035135 23625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:29.035293 23625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:29.035830 23625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:29.036626 23625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:29.036672 23625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:29.036713 23625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:29.036728 23625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:29.045436 23625 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:43047
I20260807 22:48:29.045481 23759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:43047 every 8 connection(s)
I20260807 22:48:29.046334 23625 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:48:29.050480 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 23625
I20260807 22:48:29.050624 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:48:29.050983 12739 external_mini_cluster.cc:1428] Setting key e5f77040b0fd6745972a2fbf41d67f86
Aug 07 22:48:29 dist-test-slave-tm1g krb5kdc[23365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:48:29.062201 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.048096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:53141 (local address 127.12.112.254:45911)
0807 22:48:29.048249 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:29.048253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:29.049121 (+ 868us) server_negotiation.cc:407] Connection header received
0807 22:48:29.050750 (+ 1629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:29.050753 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:29.050812 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:29.050888 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:29.052367 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.053161 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.054356 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.054664 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.054747 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.057955 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:29.057959 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:29.057961 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:29.057985 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:29.059569 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:29.060210 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:29.060213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:29.060214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:29.060290 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:29.060778 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:29.060781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:29.060782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:29.061034 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:29.061114 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:29.061887 (+ 773us) server_negotiation.cc:299] Negotiation successful
0807 22:48:29.062060 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:48:29.063331 23762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.048457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:45911 (local address 127.12.112.194:53141)
0807 22:48:29.048958 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:29.049001 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:29.050485 (+ 1484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:29.051114 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:29.051124 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:29.051605 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:29.052162 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.052176 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.053294 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.053297 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.054176 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.054185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.054823 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.054828 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.055069 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.055752 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:29.055778 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:29.057754 (+ 1976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:29.059699 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:29.059707 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:29.059723 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:29.060113 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:29.060388 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:29.060393 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:29.060396 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:29.060596 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:29.061145 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:29.061155 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:29.061544 (+ 389us) client_negotiation.cc:769] Sending connection context
0807 22:48:29.061790 (+ 246us) client_negotiation.cc:240] Negotiation successful
0807 22:48:29.062245 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":105,"threads_started":1}
I20260807 22:48:29.064769 23760 heartbeater.cc:347] Connected to a master server at 127.12.112.254:45911
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:48:29.065140 23760 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:29.065662 23760 heartbeater.cc:511] Master 127.12.112.254:45911 requested a full tablet report, sending...
I20260807 22:48:29.066740 23416 ts_manager.cc:194] Registered new tserver with Master: 8bac3ff25c9b4d1c9e85f7ba79a4b83e (127.12.112.194:43047)
I20260807 22:48:29.067343 23416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:53141
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:48:29.080933 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45911
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:45331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:48:29.193007 23767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:48:29.193260 23767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:48:29.193302 23767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:48:29.197373 23767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:48:29.197472 23767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:48:29.197532 23767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:48:29.202798 23767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:45331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:48:29.203769 23767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:48:29.204744 23767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:48:29.214377 23772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:48:29.214380 23775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:29.214494 23767 server_base.cc:1034] running on GCE node
W20260807 22:48:29.214411 23773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:48:29.215071 23767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:48:29.215685 23767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:48:29.216826 23767 hybrid_clock.cc:648] HybridClock initialized: now 1786142909216813 us; error 25 us; skew 500 ppm
Aug 07 22:48:29 dist-test-slave-tm1g krb5kdc[23365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142909, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:48:29.219794 23767 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:48:29.220700 23767 webserver.cc:460] Webserver started at http://127.12.112.195:42841/ using document root <none> and password file <none>
I20260807 22:48:29.221197 23767 fs_manager.cc:359] Metadata directory not provided
I20260807 22:48:29.221253 23767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:48:29.221415 23767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:48:29.223455 23767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "535538a390eb4425a2c9b79eb53f6ceb"
format_stamp: "Formatted at 2026-08-07 22:48:29 on dist-test-slave-tm1g"
server_key: "d6813b8810aa514beefd27b4eb7cdd0a"
server_key_iv: "4c7ff72a5849e079f7df94e2fce74021"
server_key_version: "encryptionkey@0"
I20260807 22:48:29.223959 23767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "535538a390eb4425a2c9b79eb53f6ceb"
format_stamp: "Formatted at 2026-08-07 22:48:29 on dist-test-slave-tm1g"
server_key: "d6813b8810aa514beefd27b4eb7cdd0a"
server_key_iv: "4c7ff72a5849e079f7df94e2fce74021"
server_key_version: "encryptionkey@0"
I20260807 22:48:29.227636 23767 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:48:29.229851 23782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:29.231065 23767 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:48:29.231194 23767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "535538a390eb4425a2c9b79eb53f6ceb"
format_stamp: "Formatted at 2026-08-07 22:48:29 on dist-test-slave-tm1g"
server_key: "d6813b8810aa514beefd27b4eb7cdd0a"
server_key_iv: "4c7ff72a5849e079f7df94e2fce74021"
server_key_version: "encryptionkey@0"
I20260807 22:48:29.231295 23767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:48:29.251598 23767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:48:29.255076 23767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:48:29.255295 23767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:48:29.255926 23767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:48:29.256762 23767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:48:29.256807 23767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:29.256873 23767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:48:29.256913 23767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:48:29.266352 23767 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:44047
I20260807 22:48:29.266391 23900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:44047 every 8 connection(s)
I20260807 22:48:29.267246 23767 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:48:29.267765 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 23767
I20260807 22:48:29.267925 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:48:29.268263 12739 external_mini_cluster.cc:1428] Setting key fcab11a23a807b61c4d70d9ec156f720
Aug 07 22:48:29 dist-test-slave-tm1g krb5kdc[23365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142909, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:48:29.281229 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.269125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:57327 (local address 127.12.112.254:45911)
0807 22:48:29.269279 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:29.269284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:29.270396 (+ 1112us) server_negotiation.cc:407] Connection header received
0807 22:48:29.271880 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:29.271884 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:29.271939 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:29.272016 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:29.273140 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.273695 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.274922 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.275158 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.275267 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.277616 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:29.277619 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:29.277621 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:29.277645 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:29.279157 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:29.279625 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:29.279628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:29.279629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:29.279713 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:29.280032 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:29.280034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:29.280035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:29.280331 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:29.280434 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:29.280933 (+ 499us) server_negotiation.cc:299] Negotiation successful
0807 22:48:29.281055 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:48:29.282152 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.269693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:45911 (local address 127.12.112.195:57327)
0807 22:48:29.270210 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:29.270253 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:29.271683 (+ 1430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:29.272187 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:29.272193 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:29.272546 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:48:29.273003 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.273016 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.273819 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.273823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.274798 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.274808 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.275315 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.275319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.275482 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.276007 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:48:29.276023 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:48:29.277467 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:48:29.279260 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:29.279264 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:29.279274 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:29.279517 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:29.279814 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:48:29.279817 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:48:29.279818 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:48:29.279940 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:48:29.280447 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:48:29.280452 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:48:29.280690 (+ 238us) client_negotiation.cc:769] Sending connection context
0807 22:48:29.280888 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 22:48:29.281198 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":135,"threads_started":1}
I20260807 22:48:29.283440 23901 heartbeater.cc:347] Connected to a master server at 127.12.112.254:45911
I20260807 22:48:29.283654 23901 heartbeater.cc:464] Registering TS with master...
I20260807 22:48:29.284102 23901 heartbeater.cc:511] Master 127.12.112.254:45911 requested a full tablet report, sending...
I20260807 22:48:29.285061 23416 ts_manager.cc:194] Registered new tserver with Master: 535538a390eb4425a2c9b79eb53f6ceb (127.12.112.195:44047)
I20260807 22:48:29.285643 23416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:57327
I20260807 22:48:29.294109 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:48:29.303465 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.296190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40024 (local address 127.12.112.254:45911)
0807 22:48:29.296337 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:29.296341 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:29.296462 (+ 121us) server_negotiation.cc:407] Connection header received
0807 22:48:29.296563 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:29.296566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:29.296610 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:29.296685 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:48:29.297482 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.298066 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.298965 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.299189 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.299297 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.300585 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:48:29.300588 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:48:29.300590 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:48:29.300612 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:48:29.301936 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:29.302392 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:29.302394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:29.302396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:29.302479 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:48:29.302725 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:48:29.302727 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:48:29.302728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:48:29.302947 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:48:29.303053 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:29.303237 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 22:48:29.303346 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:48:29.306464 23416 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:48:29.309520 23416 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:48:29.324271 23913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.318131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:41161 (local address 127.0.0.1:60394)
0807 22:48:29.319012 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:29.319027 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:29.319098 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:29.319858 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:29.319860 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:29.319871 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:29.320032 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.320041 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.321583 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.321587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.322911 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.322920 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.323913 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.323916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.324009 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.324028 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 22:48:29.324080 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 22:48:29.324140 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":823,"mutex_wait_us":161,"thread_start_us":77,"threads_started":1}
I20260807 22:48:29.324278 23914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.317798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:44047 (local address 127.0.0.1:39442)
0807 22:48:29.318607 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:29.318658 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:29.318797 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:29.319674 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:29.319681 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:29.319728 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:29.320028 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.320039 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.321697 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.321700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.322795 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.322805 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.323652 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.323656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.323765 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.323802 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 22:48:29.323913 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:48:29.324033 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":87,"spinlock_wait_cycles":3584,"thread_start_us":95,"threads_started":1}
I20260807 22:48:29.324376 23918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.318693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60394 (local address 127.12.112.193:41161)
0807 22:48:29.319343 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:29.319361 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:29.319384 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:48:29.319459 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:29.319464 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:29.319619 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:29.319771 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:29.320162 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.321441 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.323026 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.323810 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.323924 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.324047 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:29.324118 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 22:48:29.324217 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":82,"threads_started":1}
I20260807 22:48:29.324690 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.318497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40950 (local address 127.12.112.194:43047)
0807 22:48:29.318927 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:29.318940 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:29.318964 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:48:29.319045 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:29.319051 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:29.319553 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:29.319752 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:29.320126 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.321059 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.322785 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.323623 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.324232 (+ 609us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.324375 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:29.324429 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 22:48:29.324521 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":125,"threads_started":1}
I20260807 22:48:29.324935 23915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.317895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:43047 (local address 127.0.0.1:40950)
0807 22:48:29.318677 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:29.318693 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:29.318797 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:29.319741 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:29.319743 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:29.319767 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:29.319999 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.320008 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.321199 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.321204 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.322652 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.322664 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.323774 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.323778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.323889 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.323915 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:48:29.323963 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 22:48:29.324039 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":113,"spinlock_wait_cycles":14080,"thread_start_us":100,"threads_started":1}
I20260807 22:48:29.326059 23916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.318113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39442 (local address 127.12.112.195:44047)
0807 22:48:29.319099 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:29.319111 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:29.319134 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:48:29.319214 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:29.319221 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:29.319424 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:29.320186 (+ 762us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:29.320345 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.321531 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.322923 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.323521 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.323664 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.323813 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:29.325806 (+ 1993us) server_negotiation.cc:299] Negotiation successful
0807 22:48:29.325916 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":879,"thread_start_us":189,"threads_started":1}
I20260807 22:48:29.327536 23547 tablet_service.cc:1467] Processing CreateTablet for tablet 922a9e59af8f4eda8cf4721e998eae85 (DEFAULT_TABLE table=test-table [id=3dac58bdb4ac47bb8b7ae5691de97dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:29.327584 23690 tablet_service.cc:1467] Processing CreateTablet for tablet 922a9e59af8f4eda8cf4721e998eae85 (DEFAULT_TABLE table=test-table [id=3dac58bdb4ac47bb8b7ae5691de97dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:29.328452 23547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 922a9e59af8f4eda8cf4721e998eae85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:29.328594 23690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 922a9e59af8f4eda8cf4721e998eae85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:29.328536 23832 tablet_service.cc:1467] Processing CreateTablet for tablet 922a9e59af8f4eda8cf4721e998eae85 (DEFAULT_TABLE table=test-table [id=3dac58bdb4ac47bb8b7ae5691de97dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:48:29.329437 23832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 922a9e59af8f4eda8cf4721e998eae85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:48:29.334789 23919 tablet_bootstrap.cc:492] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9: Bootstrap starting.
I20260807 22:48:29.336467 23920 tablet_bootstrap.cc:492] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: Bootstrap starting.
I20260807 22:48:29.336575 23921 tablet_bootstrap.cc:492] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: Bootstrap starting.
I20260807 22:48:29.337283 23919 tablet_bootstrap.cc:654] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:29.338476 23919 log.cc:824] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:29.338637 23921 tablet_bootstrap.cc:654] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:29.339149 23920 tablet_bootstrap.cc:654] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: Neither blocks nor log segments found. Creating new log.
I20260807 22:48:29.339967 23920 log.cc:824] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:29.339967 23921 log.cc:824] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: Log is configured to *not* fsync() on all Append() calls
I20260807 22:48:29.340830 23919 tablet_bootstrap.cc:492] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9: No bootstrap required, opened a new log
I20260807 22:48:29.341048 23919 ts_tablet_manager.cc:1397] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 22:48:29.341806 23920 tablet_bootstrap.cc:492] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: No bootstrap required, opened a new log
I20260807 22:48:29.342020 23920 ts_tablet_manager.cc:1397] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:48:29.342367 23921 tablet_bootstrap.cc:492] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: No bootstrap required, opened a new log
I20260807 22:48:29.342548 23921 ts_tablet_manager.cc:1397] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:48:29.344960 23920 raft_consensus.cc:348] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535538a390eb4425a2c9b79eb53f6ceb" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44047 } } peers { permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 } } peers { permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 } }
I20260807 22:48:29.345218 23920 raft_consensus.cc:374] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:29.345073 23919 raft_consensus.cc:348] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535538a390eb4425a2c9b79eb53f6ceb" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44047 } } peers { permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 } } peers { permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 } }
I20260807 22:48:29.345290 23920 raft_consensus.cc:729] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bac3ff25c9b4d1c9e85f7ba79a4b83e, State: Initialized, Role: FOLLOWER
I20260807 22:48:29.345341 23919 raft_consensus.cc:374] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:29.345403 23919 raft_consensus.cc:729] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 032bfceaef8a475dbc4343acf881aff9, State: Initialized, Role: FOLLOWER
I20260807 22:48:29.345753 23920 consensus_queue.cc:260] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535538a390eb4425a2c9b79eb53f6ceb" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44047 } } peers { permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 } } peers { permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 } }
I20260807 22:48:29.345845 23919 consensus_queue.cc:260] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535538a390eb4425a2c9b79eb53f6ceb" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44047 } } peers { permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 } } peers { permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 } }
I20260807 22:48:29.346336 23921 raft_consensus.cc:348] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535538a390eb4425a2c9b79eb53f6ceb" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44047 } } peers { permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 } } peers { permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 } }
I20260807 22:48:29.346570 23921 raft_consensus.cc:374] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:48:29.346623 23921 raft_consensus.cc:729] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 535538a390eb4425a2c9b79eb53f6ceb, State: Initialized, Role: FOLLOWER
I20260807 22:48:29.346834 23920 ts_tablet_manager.cc:1428] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 22:48:29.346854 23919 ts_tablet_manager.cc:1428] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260807 22:48:29.347034 23921 consensus_queue.cc:260] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535538a390eb4425a2c9b79eb53f6ceb" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44047 } } peers { permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 } } peers { permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 } }
I20260807 22:48:29.347229 23618 heartbeater.cc:503] Master 127.12.112.254:45911 was elected leader, sending a full tablet report...
I20260807 22:48:29.347718 23901 heartbeater.cc:503] Master 127.12.112.254:45911 was elected leader, sending a full tablet report...
I20260807 22:48:29.347935 23921 ts_tablet_manager.cc:1428] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:48:29.348322 23760 heartbeater.cc:503] Master 127.12.112.254:45911 was elected leader, sending a full tablet report...
W20260807 22:48:29.518438 23902 tablet.cc:2369] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:48:29.520527 23927 raft_consensus.cc:482] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:48:29.520753 23927 raft_consensus.cc:504] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535538a390eb4425a2c9b79eb53f6ceb" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44047 } } peers { permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 } } peers { permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 } }
I20260807 22:48:29.521900 23927 leader_election.cc:288] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bac3ff25c9b4d1c9e85f7ba79a4b83e (127.12.112.194:43047), 032bfceaef8a475dbc4343acf881aff9 (127.12.112.193:41161)
I20260807 22:48:29.527238 23918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.522466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:38399 (local address 127.12.112.193:41161)
0807 22:48:29.522616 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:29.522619 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:29.522648 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:48:29.522698 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:29.522700 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:29.522779 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:29.522860 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:29.523201 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.524007 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.525929 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.526558 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.526683 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.526734 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:29.527036 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 22:48:29.527106 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:48:29.527238 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.522289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:54523 (local address 127.12.112.194:43047)
0807 22:48:29.522449 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:29.522453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:29.522765 (+ 312us) server_negotiation.cc:407] Connection header received
0807 22:48:29.522826 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:29.522831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:29.522888 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:29.522960 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:48:29.523209 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.524001 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.525929 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.526562 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.526683 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.526734 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:29.527036 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 22:48:29.527106 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 22:48:29.527321 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.522221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:41161 (local address 127.12.112.195:38399)
0807 22:48:29.522456 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:29.522473 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:29.522579 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:29.522889 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:29.522891 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:29.522904 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:29.523055 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.523066 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.524151 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.524155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.525771 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.525783 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.526687 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.526690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.526850 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.526922 (+ 72us) client_negotiation.cc:769] Sending connection context
0807 22:48:29.527005 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 22:48:29.527163 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":252}
I20260807 22:48:29.527335 23928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.522221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:43047 (local address 127.12.112.195:54523)
0807 22:48:29.522658 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:29.522670 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:48:29.522758 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:48:29.522983 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:48:29.522985 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:48:29.522997 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:48:29.523097 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.523107 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.524154 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.524157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.525771 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:48:29.525783 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.526687 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.526690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:48:29.526822 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.526922 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 22:48:29.527005 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 22:48:29.527163 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":290,"thread_start_us":123,"threads_started":1}
I20260807 22:48:29.528008 23570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "922a9e59af8f4eda8cf4721e998eae85" candidate_uuid: "535538a390eb4425a2c9b79eb53f6ceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "032bfceaef8a475dbc4343acf881aff9" is_pre_election: true
I20260807 22:48:29.528322 23570 raft_consensus.cc:2454] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 535538a390eb4425a2c9b79eb53f6ceb in term 0.
I20260807 22:48:29.528614 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "922a9e59af8f4eda8cf4721e998eae85" candidate_uuid: "535538a390eb4425a2c9b79eb53f6ceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" is_pre_election: true
I20260807 22:48:29.528856 23784 leader_election.cc:302] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 032bfceaef8a475dbc4343acf881aff9, 535538a390eb4425a2c9b79eb53f6ceb; no voters:
I20260807 22:48:29.528890 23711 raft_consensus.cc:2454] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 535538a390eb4425a2c9b79eb53f6ceb in term 0.
I20260807 22:48:29.529103 23927 raft_consensus.cc:2781] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:48:29.529207 23927 raft_consensus.cc:482] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:48:29.529274 23927 raft_consensus.cc:3037] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:29.530452 23927 raft_consensus.cc:504] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535538a390eb4425a2c9b79eb53f6ceb" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44047 } } peers { permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 } } peers { permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 } }
I20260807 22:48:29.530819 23927 leader_election.cc:288] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [CANDIDATE]: Term 1 election: Requested vote from peers 8bac3ff25c9b4d1c9e85f7ba79a4b83e (127.12.112.194:43047), 032bfceaef8a475dbc4343acf881aff9 (127.12.112.193:41161)
I20260807 22:48:29.531165 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "922a9e59af8f4eda8cf4721e998eae85" candidate_uuid: "535538a390eb4425a2c9b79eb53f6ceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e"
I20260807 22:48:29.531162 23570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "922a9e59af8f4eda8cf4721e998eae85" candidate_uuid: "535538a390eb4425a2c9b79eb53f6ceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "032bfceaef8a475dbc4343acf881aff9"
I20260807 22:48:29.531308 23711 raft_consensus.cc:3037] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:29.531322 23570 raft_consensus.cc:3037] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:48:29.532299 23570 raft_consensus.cc:2454] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 535538a390eb4425a2c9b79eb53f6ceb in term 1.
I20260807 22:48:29.532401 23711 raft_consensus.cc:2454] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 535538a390eb4425a2c9b79eb53f6ceb in term 1.
I20260807 22:48:29.532605 23784 leader_election.cc:302] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 032bfceaef8a475dbc4343acf881aff9, 535538a390eb4425a2c9b79eb53f6ceb; no voters:
I20260807 22:48:29.532783 23927 raft_consensus.cc:2781] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:48:29.533023 23927 raft_consensus.cc:686] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 1 LEADER]: Becoming Leader. State: Replica: 535538a390eb4425a2c9b79eb53f6ceb, State: Running, Role: LEADER
I20260807 22:48:29.533352 23927 consensus_queue.cc:237] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535538a390eb4425a2c9b79eb53f6ceb" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44047 } } peers { permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 } } peers { permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 } }
I20260807 22:48:29.536561 23414 catalog_manager.cc:5495] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb reported cstate change: term changed from 0 to 1, leader changed from <none> to 535538a390eb4425a2c9b79eb53f6ceb (127.12.112.195). New cstate: current_term: 1 leader_uuid: "535538a390eb4425a2c9b79eb53f6ceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535538a390eb4425a2c9b79eb53f6ceb" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 44047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 } health_report { overall_health: UNKNOWN } } }
W20260807 22:48:29.547436 23761 tablet.cc:2369] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:48:29.558125 23916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.554844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39456 (local address 127.12.112.195:44047)
0807 22:48:29.554983 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 22:48:29.554987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:48:29.554999 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:48:29.555072 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:48:29.555074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:48:29.555131 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:48:29.555215 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:48:29.555444 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.555946 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.556736 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:48:29.556959 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:48:29.557036 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:48:29.557293 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:48:29.557688 (+ 395us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:48:29.557774 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:48:29.557881 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 22:48:29.557953 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:48:29.564015 23570 raft_consensus.cc:1261] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9 [term 1 FOLLOWER]: Refusing update from remote peer 535538a390eb4425a2c9b79eb53f6ceb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:29.564033 23711 raft_consensus.cc:1261] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e [term 1 FOLLOWER]: Refusing update from remote peer 535538a390eb4425a2c9b79eb53f6ceb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:48:29.564788 23929 consensus_queue.cc:1035] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "032bfceaef8a475dbc4343acf881aff9" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:29.564965 23927 consensus_queue.cc:1035] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bac3ff25c9b4d1c9e85f7ba79a4b83e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:48:29.572781 23935 mvcc.cc:205] Tried to move back new op lower bound from 7316041357566537728 to 7316041357451350016. Current Snapshot: MvccSnapshot[applied={T|T < 7316041357566537728}]
I20260807 22:48:29.574617 23934 mvcc.cc:205] Tried to move back new op lower bound from 7316041357566537728 to 7316041357451350016. Current Snapshot: MvccSnapshot[applied={T|T < 7316041357566537728}]
I20260807 22:48:29.579972 23414 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:29.580153 23414 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:48:29.582578 23414 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fb6063124c7a467ca18eb5fa33ff1915: Sending DeleteTablet for 3 replicas of tablet 922a9e59af8f4eda8cf4721e998eae85
I20260807 22:48:29.583405 23547 tablet_service.cc:1514] Processing DeleteTablet for tablet 922a9e59af8f4eda8cf4721e998eae85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:29 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:60394
I20260807 22:48:29.583427 23832 tablet_service.cc:1514] Processing DeleteTablet for tablet 922a9e59af8f4eda8cf4721e998eae85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:29 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:39442
I20260807 22:48:29.583779 23690 tablet_service.cc:1514] Processing DeleteTablet for tablet 922a9e59af8f4eda8cf4721e998eae85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:48:29 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:40950
I20260807 22:48:29.583909 23943 tablet_replica.cc:330] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: stopping tablet replica
I20260807 22:48:29.584043 23944 tablet_replica.cc:330] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9: stopping tablet replica
I20260807 22:48:29.584199 23943 raft_consensus.cc:2229] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:48:29.584247 23944 raft_consensus.cc:2229] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:48:29.584514 23944 raft_consensus.cc:2258] T 922a9e59af8f4eda8cf4721e998eae85 P 032bfceaef8a475dbc4343acf881aff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:29.584553 23943 raft_consensus.cc:2258] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:29.584777 23945 tablet_replica.cc:330] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: stopping tablet replica
I20260807 22:48:29.585322 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 23482
I20260807 22:48:29.585521 23945 raft_consensus.cc:2229] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:48:29.585847 23945 raft_consensus.cc:2258] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:48:29.590790 23945 ts_tablet_manager.cc:1905] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:48:29.593101 23945 ts_tablet_manager.cc:1918] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:48:29.593223 23945 log.cc:1196] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/922a9e59af8f4eda8cf4721e998eae85
I20260807 22:48:29.593551 23945 ts_tablet_manager.cc:1939] T 922a9e59af8f4eda8cf4721e998eae85 P 8bac3ff25c9b4d1c9e85f7ba79a4b83e: Deleting consensus metadata
I20260807 22:48:29.595036 23397 catalog_manager.cc:4841] TS 8bac3ff25c9b4d1c9e85f7ba79a4b83e (127.12.112.194:43047): tablet 922a9e59af8f4eda8cf4721e998eae85 (table test-table [id=3dac58bdb4ac47bb8b7ae5691de97dcd]) successfully deleted
I20260807 22:48:29.599459 23943 ts_tablet_manager.cc:1905] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 22:48:29.601574 23396 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:41161 (error 108)
I20260807 22:48:29.602749 23915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:48:29.602432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:41161 (local address 127.0.0.1:60404)
0807 22:48:29.602586 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 22:48:29.602659 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:41161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 22:48:29.602819 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 23625
I20260807 22:48:29.602823 23943 ts_tablet_manager.cc:1918] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:48:29.602918 23943 log.cc:1196] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/922a9e59af8f4eda8cf4721e998eae85
I20260807 22:48:29.603267 23943 ts_tablet_manager.cc:1939] T 922a9e59af8f4eda8cf4721e998eae85 P 535538a390eb4425a2c9b79eb53f6ceb: Deleting consensus metadata
I20260807 22:48:29.604578 23395 catalog_manager.cc:4841] TS 535538a390eb4425a2c9b79eb53f6ceb (127.12.112.195:44047): tablet 922a9e59af8f4eda8cf4721e998eae85 (table test-table [id=3dac58bdb4ac47bb8b7ae5691de97dcd]) successfully deleted
W20260807 22:48:29.606570 23396 catalog_manager.cc:4584] TS 032bfceaef8a475dbc4343acf881aff9 (127.12.112.193:41161): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 922a9e59af8f4eda8cf4721e998eae85: Network error: Client connection negotiation failed: client connection to 127.12.112.193:41161: connect: Connection refused (error 111)
I20260807 22:48:29.611388 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 23767
I20260807 22:48:29.617057 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 23378
2026-08-07T22:48:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2480 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:48:29 dist-test-slave-tm1g krb5kdc[23949](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:48:29 dist-test-slave-tm1g krb5kdc[23949](info): set up 2 sockets
Aug 07 22:48:29 dist-test-slave-tm1g krb5kdc[23949](info): commencing operation
krb5kdc: starting...
W20260807 22:48:30.703696 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:48:30 dist-test-slave-tm1g krb5kdc[23949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:48:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:48:30Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.112.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.112.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/rangeradmin_127.12.112.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/rangeradmin_127.12.112.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.112.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.112.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/rangerlookup_127.12.112.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/rangerlookup_127.12.112.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.112.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.112.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/HTTP_127.12.112.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/HTTP_127.12.112.212@KRBTEST.COM.keytab.
I20260807 22:48:30.876703 12739 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasksZtO5S/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/postgres -l logfile start
2026-08-07 22:48:33.341 UTC [23979] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 22:48:33.341 UTC [23979] LOG: listening on IPv4 address "127.12.112.212", port 47245
2026-08-07 22:48:33.344 UTC [23979] LOG: listening on Unix socket "/tmp/.s.PGSQL.47245"
2026-08-07 22:48:33.366 UTC [23983] LOG: database system was shut down at 2026-08-07 22:48:31 UTC
2026-08-07 22:48:33.369 UTC [23979] LOG: database system is ready to accept connections
I20260807 22:48:34.342908 12739 mini_postgres.cc:96] Postgres bound to 47245
2026-08-07 22:48:34.350 UTC [23992] FATAL: database "slave" does not exist
127.12.112.212:47245 - accepting connections
I20260807 22:48:34.350884 12739 mini_ranger.cc:161] Starting Ranger...
I20260807 22:48:34.366223 12739 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 22:48:34.796710 12739 mini_ranger.cc:87] Created ranger Postgres database
I20260807 22:48:34.796813 12739 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-admin
2026-08-07 22:48:35,098 [I] DB FLAVOR :POSTGRES
2026-08-07 22:48:35,099 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:48:35,099 [I] Checking connection..
2026-08-07 22:48:35,099 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 22:48:35,368 [I] Checking connection passed.
2026-08-07 22:48:35,368 [I] --------- Verifying version history table ---------
2026-08-07 22:48:35,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:48:35,631 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:48:35,631 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:48:35,901 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:48:35,901 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 22:48:35,901 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 22:48:36.162 UTC [24063] WARNING: there is no transaction in progress
2026-08-07 22:48:36,169 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 22:48:36,169 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:48:36,427 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 22:48:36,427 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:48:36,427 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 22:48:36,685 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 22:48:36,922 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-tm1g.c.gcp-upstream.internal','N') ;"
2026-08-07 22:48:37,179 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:48:37,446 [I] Table x_portal_user does not exist in database ranger
2026-08-07 22:48:37,447 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:48:37,691 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 22:48:37,691 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:48:37,949 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:48:38,202 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 22:48:38,202 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 22:48:39.140 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.155 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.170 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.184 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.200 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.216 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.267 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.273 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.287 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.296 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.306 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.320 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.329 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.335 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.341 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39.347 UTC [24175] WARNING: there is no transaction in progress
2026-08-07 22:48:39,960 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 22:48:39,960 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 22:48:40,215 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 22:48:40,216 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:48:40,470 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 22:48:40,470 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:48:40,740 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 22:48:40,741 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:48:40,991 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:48:41,257 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-tm1g.c.gcp-upstream.internal';"
2026-08-07 22:48:41,503 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 22:48:41,503 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 22:48:41,769 [I] DB_PATCHES have already been applied
I20260807 22:48:41.775535 12739 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-admin:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasksZtO5S/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 22:48:41.775599 12739 mini_ranger.cc:193] Using host: 127.12.112.212
I20260807 22:48:41.779747 12739 mini_ranger.cc:227] Ranger admin URL: http://127.12.112.212:39077
Aug 07, 2026 10:48:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:48:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:48:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 10:48:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 10:48:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 10:48:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 10:48:42 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 22:48:42.910804 12739 mini_ranger.cc:160] Time spent starting Ranger: real 8.560s user 0.002s sys 0.010s
Aug 07, 2026 10:49:02 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 10:49:02 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 07, 2026 10:49:02 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 10:49:02 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 10:49:03 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 22:49:04.364848 12739 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.112.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.112.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/rangerkms_127.12.112.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/rangerkms_127.12.112.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.112.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.112.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.112.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/HTTP_127.12.112.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.112.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/HTTP_127.12.112.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 22:49:04 dist-test-slave-tm1g krb5kdc[23949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142944, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 22:49:04.469909 12739 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 22:49:04.480202 12739 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 22:49:05.289885 12739 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 22:49:05.289970 12739 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-kms
I20260807 22:49:05.290071 12739 mini_ranger_kms.cc:227] Using postgres at 127.12.112.212:47245
2026-08-07 22:49:05,521 [I] DB FLAVOR :POSTGRES
2026-08-07 22:49:05,521 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:49:05,521 [I] Checking connection
2026-08-07 22:49:05,521 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 22:49:05,776 [I] connection success
2026-08-07 22:49:05,776 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 22:49:05,776 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 22:49:05,777 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 22:49:06,007 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 22:49:06,007 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:49:06,007 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 22:49:06,008 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:47245/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 22:49:06,269 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 22:49:06.748991 12739 mini_ranger_kms.cc:310] Created kms service
I20260807 22:49:06.973232 12739 mini_ranger_kms.cc:326] Created kudu user
I20260807 22:49:07.020376 12739 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 22:49:07 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142944, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:49:07.426628 12739 mini_ranger_kms.cc:384] Added ranger policy
I20260807 22:49:07.426782 12739 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-kms:/tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 22:49:07.426806 12739 mini_ranger_kms.cc:240] Using host: 127.12.112.212
I20260807 22:49:07.431731 12739 mini_ranger_kms.cc:276] Ranger KMS PID: 24368
I20260807 22:49:07.431859 12739 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.112.212:38717
Aug 07, 2026 10:49:08 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:49:08 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:49:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 10:49:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 10:49:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 10:49:09 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260807 22:49:09.790575 12739 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.321s user 0.004s sys 0.211s
I20260807 22:49:09.790721 12739 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 22:49:09.790861 12739 mini_ranger_kms.cc:401] 127.12.112.212:38717/kms/v1/keys
Aug 07 22:49:09 dist-test-slave-tm1g krb5kdc[23949](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142949, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.112.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 22:49:10 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142949, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.112.212@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
Aug 07 22:49:10 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142949, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.112.212@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
Aug 07 22:49:12 dist-test-slave-tm1g krb5kdc[23949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142952, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:49:12.917649 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36029
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:43075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:36029
--ranger_config_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:38717/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:49:13.029072 24421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:49:13.029325 24421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:49:13.029373 24421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:49:13.033418 24421 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:49:13.033473 24421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:49:13.033492 24421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:49:13.033509 24421 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:49:13.033558 24421 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:49:13.039059 24421 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:43075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.112.212:38717/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:36029
--ranger_config_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:49:13.040059 24421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:49:13.041054 24421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:49:13.050094 24430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:49:13.050062 24426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:49:13.050081 24427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:49:13.050072 24421 server_base.cc:1034] running on GCE node
I20260807 22:49:13.051018 24421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:49:13.052244 24421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:49:13.053434 24421 hybrid_clock.cc:648] HybridClock initialized: now 1786142953053419 us; error 34 us; skew 500 ppm
Aug 07 22:49:13 dist-test-slave-tm1g krb5kdc[23949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142953, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:49:13.063021 24421 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:49:13.063915 24421 webserver.cc:460] Webserver started at http://127.12.112.254:39975/ using document root <none> and password file <none>
I20260807 22:49:13.064467 24421 fs_manager.cc:359] Metadata directory not provided
I20260807 22:49:13.064550 24421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:49:13.064783 24421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:49:13 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142953, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:49:13.113080 24421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "49be3dae64ea40419b4c4da7980db6e1"
format_stamp: "Formatted at 2026-08-07 22:49:13 on dist-test-slave-tm1g"
server_key: "75159484313b85cbb1c3448ff5a1ed15"
server_key_iv: "2b61479dd6bde770a58fdd9d4fc43373"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:13.113848 24421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "49be3dae64ea40419b4c4da7980db6e1"
format_stamp: "Formatted at 2026-08-07 22:49:13 on dist-test-slave-tm1g"
server_key: "75159484313b85cbb1c3448ff5a1ed15"
server_key_iv: "2b61479dd6bde770a58fdd9d4fc43373"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:13.118950 24421 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 22:49:13.137218 24437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:49:13.138824 24421 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:49:13.138993 24421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "49be3dae64ea40419b4c4da7980db6e1"
format_stamp: "Formatted at 2026-08-07 22:49:13 on dist-test-slave-tm1g"
server_key: "75159484313b85cbb1c3448ff5a1ed15"
server_key_iv: "2b61479dd6bde770a58fdd9d4fc43373"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:13.139130 24421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:49:13.171413 24421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:49:13.174418 24421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:49:13.174641 24421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:49:13.182017 24421 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:36029
I20260807 22:49:13.182029 24491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:36029 every 8 connection(s)
I20260807 22:49:13.183029 24421 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:49:13.185778 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 24421
I20260807 22:49:13.185926 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:49:13.186226 24492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:49:13.186370 12739 external_mini_cluster.cc:1428] Setting key 5f3fbeae1b11afe19be96ea5df8bc73f
I20260807 22:49:13.193254 24492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1: Bootstrap starting.
Aug 07 22:49:13 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142952, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:49:13.196022 24492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1: Neither blocks nor log segments found. Creating new log.
I20260807 22:49:13.196751 24492 log.cc:824] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1: Log is configured to *not* fsync() on all Append() calls
I20260807 22:49:13.198628 24492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1: No bootstrap required, opened a new log
I20260807 22:49:13.201197 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:13.187725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58818 (local address 127.12.112.254:36029)
0807 22:49:13.188167 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:13.188183 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:13.188218 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:49:13.188967 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:13.188986 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:13.189297 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:13.189570 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:49:13.190529 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:13.191519 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:13.192695 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:13.193152 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:13.193264 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:13.196130 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:49:13.196145 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:49:13.196158 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:49:13.196185 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:49:13.198475 (+ 2290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:49:13.198982 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:49:13.198988 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:49:13.198992 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:49:13.199096 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:49:13.199389 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:49:13.199392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:49:13.199394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:49:13.199775 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:49:13.200006 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:13.200236 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 22:49:13.200508 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":165,"threads_started":1}
I20260807 22:49:13.201782 24492 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49be3dae64ea40419b4c4da7980db6e1" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36029 } }
I20260807 22:49:13.202039 24492 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:49:13.202101 24492 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49be3dae64ea40419b4c4da7980db6e1, State: Initialized, Role: FOLLOWER
I20260807 22:49:13.202564 24492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49be3dae64ea40419b4c4da7980db6e1" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36029 } }
I20260807 22:49:13.202687 24492 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:49:13.202768 24492 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:49:13.202869 24492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:49:13.203905 24492 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49be3dae64ea40419b4c4da7980db6e1" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36029 } }
I20260807 22:49:13.204226 24492 leader_election.cc:302] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49be3dae64ea40419b4c4da7980db6e1; no voters:
I20260807 22:49:13.204540 24492 leader_election.cc:288] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:49:13.204677 24497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:49:13.204922 24497 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [term 1 LEADER]: Becoming Leader. State: Replica: 49be3dae64ea40419b4c4da7980db6e1, State: Running, Role: LEADER
I20260807 22:49:13.205219 24497 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49be3dae64ea40419b4c4da7980db6e1" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36029 } }
I20260807 22:49:13.205744 24492 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:49:13.206914 24499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49be3dae64ea40419b4c4da7980db6e1. Latest consensus state: current_term: 1 leader_uuid: "49be3dae64ea40419b4c4da7980db6e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49be3dae64ea40419b4c4da7980db6e1" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36029 } } }
I20260807 22:49:13.207053 24499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:49:13.207404 24498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49be3dae64ea40419b4c4da7980db6e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49be3dae64ea40419b4c4da7980db6e1" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36029 } } }
I20260807 22:49:13.207509 24498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:49:13.207479 24507 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:49:13.208465 24492 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 22:49:13.213835 24507 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:49:13.221581 24507 catalog_manager.cc:1347] Generated new cluster ID: 1fd90465f56d4c7a8b25fee3ba15259b
I20260807 22:49:13.221648 24507 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:49:13.229676 24507 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:49:13.230916 24507 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:49:13.245657 24507 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1: Generated new TSK 0
I20260807 22:49:13.246520 24507 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:49:13.950249 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:38717/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36029
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:43075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:49:14.069625 24539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:49:14.069901 24539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:49:14.070019 24539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:49:14.074397 24539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:49:14.074486 24539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:49:14.074579 24539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:49:14.080520 24539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:43075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.112.212:38717/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:49:14.081997 24539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:49:14.083112 24539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:49:14.093698 24544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:49:14.094143 24547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:49:14.094385 24545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:49:14.095536 24539 server_base.cc:1034] running on GCE node
I20260807 22:49:14.096014 24539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:49:14.096757 24539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:49:14.100016 24539 hybrid_clock.cc:648] HybridClock initialized: now 1786142954100320 us; error 375 us; skew 500 ppm
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:49:14.103237 24539 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:49:14.104202 24539 webserver.cc:460] Webserver started at http://127.12.112.193:35107/ using document root <none> and password file <none>
I20260807 22:49:14.104768 24539 fs_manager.cc:359] Metadata directory not provided
I20260807 22:49:14.104827 24539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:49:14.105049 24539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:49:14.121042 24539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "27211ad560df42f69400118b3b972933"
format_stamp: "Formatted at 2026-08-07 22:49:14 on dist-test-slave-tm1g"
server_key: "97eaaf598d5d60e7a39ee943818dd0bb"
server_key_iv: "2855728d0a537e24276be676e6d60ffd"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:14.121667 24539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "27211ad560df42f69400118b3b972933"
format_stamp: "Formatted at 2026-08-07 22:49:14 on dist-test-slave-tm1g"
server_key: "97eaaf598d5d60e7a39ee943818dd0bb"
server_key_iv: "2855728d0a537e24276be676e6d60ffd"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:14.127429 24539 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 22:49:14.149132 24556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:49:14.150604 24539 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:49:14.150740 24539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "27211ad560df42f69400118b3b972933"
format_stamp: "Formatted at 2026-08-07 22:49:14 on dist-test-slave-tm1g"
server_key: "97eaaf598d5d60e7a39ee943818dd0bb"
server_key_iv: "2855728d0a537e24276be676e6d60ffd"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:14.150882 24539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:49:14.187330 24539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:49:14.191161 24539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:49:14.191421 24539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:49:14.192179 24539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:49:14.193238 24539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:49:14.193360 24539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:49:14.193490 24539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:49:14.193575 24539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:49:14.204203 24539 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:42215
I20260807 22:49:14.205542 24539 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:49:14.209466 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 24539
I20260807 22:49:14.209595 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:49:14.209951 12739 external_mini_cluster.cc:1428] Setting key bdc08573a7774acd89b4c369aba7fa91
I20260807 22:49:14.221539 24678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:42215 every 8 connection(s)
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:49:14.236572 24682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.220409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:46897 (local address 127.12.112.254:36029)
0807 22:49:14.222296 (+ 1887us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:14.222307 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:14.222910 (+ 603us) server_negotiation.cc:407] Connection header received
0807 22:49:14.224142 (+ 1232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:14.224146 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:14.224201 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:14.224263 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:49:14.225884 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.226611 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.228391 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.228820 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.228930 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.232064 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:49:14.232068 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:49:14.232070 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:49:14.232099 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:49:14.234051 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:49:14.234720 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:49:14.234724 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:49:14.234726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:49:14.234821 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:49:14.235258 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:49:14.235261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:49:14.235263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:49:14.235487 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:49:14.235570 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:14.236238 (+ 668us) server_negotiation.cc:299] Negotiation successful
0807 22:49:14.236375 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1798,"thread_start_us":90,"threads_started":1}
I20260807 22:49:14.238471 24683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.220943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36029 (local address 127.12.112.193:46897)
0807 22:49:14.222612 (+ 1669us) negotiation.cc:107] Waiting for socket to connect
0807 22:49:14.222669 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 22:49:14.223897 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:49:14.224750 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:49:14.224756 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:49:14.225123 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:49:14.225731 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.225745 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.226771 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.226774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.228240 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.228252 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.229144 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.229148 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.229339 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.230061 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:49:14.230082 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:49:14.231861 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:49:14.234200 (+ 2339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:49:14.234206 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:49:14.234221 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:49:14.234594 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:49:14.234960 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:49:14.234963 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:49:14.234965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:49:14.235145 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:49:14.235638 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:49:14.235644 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:49:14.235951 (+ 307us) client_negotiation.cc:769] Sending connection context
0807 22:49:14.237053 (+ 1102us) client_negotiation.cc:240] Negotiation successful
0807 22:49:14.237418 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1441,"thread_start_us":127,"threads_started":1}
I20260807 22:49:14.240361 24679 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36029
I20260807 22:49:14.240600 24679 heartbeater.cc:464] Registering TS with master...
I20260807 22:49:14.241184 24679 heartbeater.cc:511] Master 127.12.112.254:36029 requested a full tablet report, sending...
I20260807 22:49:14.243095 24455 ts_manager.cc:194] Registered new tserver with Master: 27211ad560df42f69400118b3b972933 (127.12.112.193:42215)
I20260807 22:49:14.244702 24455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:46897
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:49:14.256896 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:38717/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36029
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:43075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 22:49:14.383270 24687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:49:14.383651 24687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:49:14.383747 24687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:49:14.388237 24687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:49:14.388345 24687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:49:14.388443 24687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:49:14.393953 24687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:43075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.112.212:38717/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:49:14.395049 24687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:49:14.396157 24687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:49:14.405920 24693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:49:14.405920 24694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:49:14.406443 24696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:49:14.407002 24687 server_base.cc:1034] running on GCE node
I20260807 22:49:14.407464 24687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:49:14.408145 24687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:49:14.409327 24687 hybrid_clock.cc:648] HybridClock initialized: now 1786142954409288 us; error 44 us; skew 500 ppm
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:49:14.412472 24687 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:49:14.413568 24687 webserver.cc:460] Webserver started at http://127.12.112.194:43429/ using document root <none> and password file <none>
I20260807 22:49:14.414258 24687 fs_manager.cc:359] Metadata directory not provided
I20260807 22:49:14.414367 24687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:49:14.414592 24687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:49:14.430215 24687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "dd33d0cf216648ffa0ee1a468e441172"
format_stamp: "Formatted at 2026-08-07 22:49:14 on dist-test-slave-tm1g"
server_key: "305c1406b065ab5b3e18ff84cc4d3057"
server_key_iv: "cf41db1873a3e1bb3d28959f60095ca0"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:14.431006 24687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "dd33d0cf216648ffa0ee1a468e441172"
format_stamp: "Formatted at 2026-08-07 22:49:14 on dist-test-slave-tm1g"
server_key: "305c1406b065ab5b3e18ff84cc4d3057"
server_key_iv: "cf41db1873a3e1bb3d28959f60095ca0"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:14.436210 24687 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 22:49:14.453083 24704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:49:14.454816 24687 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:49:14.454967 24687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "dd33d0cf216648ffa0ee1a468e441172"
format_stamp: "Formatted at 2026-08-07 22:49:14 on dist-test-slave-tm1g"
server_key: "305c1406b065ab5b3e18ff84cc4d3057"
server_key_iv: "cf41db1873a3e1bb3d28959f60095ca0"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:14.455108 24687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:49:14.474104 24687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:49:14.479501 24687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:49:14.479755 24687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:49:14.480492 24687 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:49:14.481526 24687 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:49:14.481590 24687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:49:14.481644 24687 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:49:14.481673 24687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:49:14.492584 24687 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:40185
I20260807 22:49:14.493690 24687 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:49:14.494670 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 24687
I20260807 22:49:14.494812 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:49:14.495157 12739 external_mini_cluster.cc:1428] Setting key 1a763e2c9a4f81711432d5aee6671a7d
I20260807 22:49:14.498799 24824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:40185 every 8 connection(s)
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:49:14.516366 24682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.500676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:43621 (local address 127.12.112.254:36029)
0807 22:49:14.502178 (+ 1502us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:14.502183 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:14.502201 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:49:14.503216 (+ 1015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:14.503221 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:14.503296 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:14.503363 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:49:14.505021 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.505885 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.507670 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.508031 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.508117 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.511503 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:49:14.511507 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:49:14.511510 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:49:14.511538 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:49:14.513411 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:49:14.514532 (+ 1121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:49:14.514536 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:49:14.514538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:49:14.514628 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:49:14.515045 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:49:14.515048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:49:14.515050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:49:14.515280 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:49:14.515367 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:14.516048 (+ 681us) server_negotiation.cc:299] Negotiation successful
0807 22:49:14.516189 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1410}
I20260807 22:49:14.517994 24828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.501178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36029 (local address 127.12.112.194:43621)
0807 22:49:14.501782 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0807 22:49:14.501846 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 22:49:14.502958 (+ 1112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:49:14.503792 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:49:14.503802 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:49:14.504159 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:49:14.504845 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.504864 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.506056 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.506059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.507521 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.507533 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.508351 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.508354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.508552 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.509408 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:49:14.509432 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:49:14.511321 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:49:14.513993 (+ 2672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:49:14.514000 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:49:14.514016 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:49:14.514405 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:49:14.514737 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:49:14.514740 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:49:14.514742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:49:14.514929 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:49:14.515439 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:49:14.515446 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:49:14.515751 (+ 305us) client_negotiation.cc:769] Sending connection context
0807 22:49:14.516611 (+ 860us) client_negotiation.cc:240] Negotiation successful
0807 22:49:14.516964 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":144,"threads_started":1}
I20260807 22:49:14.519310 24825 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36029
I20260807 22:49:14.519551 24825 heartbeater.cc:464] Registering TS with master...
I20260807 22:49:14.520143 24825 heartbeater.cc:511] Master 127.12.112.254:36029 requested a full tablet report, sending...
I20260807 22:49:14.521363 24455 ts_manager.cc:194] Registered new tserver with Master: dd33d0cf216648ffa0ee1a468e441172 (127.12.112.194:40185)
I20260807 22:49:14.522121 24455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:43621
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:49:14.534168 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:38717/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36029
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:43075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:49:14.688491 24830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:49:14.688943 24830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:49:14.689066 24830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:49:14.695091 24830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:49:14.695166 24830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:49:14.695255 24830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:49:14.703069 24830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:43075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.112.212:38717/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:49:14.704507 24830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:49:14.705909 24830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:49:14.719149 24838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:49:14.719151 24839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:49:14.719678 24841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:49:14.720448 24830 server_base.cc:1034] running on GCE node
I20260807 22:49:14.720899 24830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:49:14.721690 24830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:49:14.722898 24830 hybrid_clock.cc:648] HybridClock initialized: now 1786142954722874 us; error 37 us; skew 500 ppm
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:49:14.726614 24830 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:49:14.727684 24830 webserver.cc:460] Webserver started at http://127.12.112.195:34211/ using document root <none> and password file <none>
I20260807 22:49:14.728411 24830 fs_manager.cc:359] Metadata directory not provided
I20260807 22:49:14.728502 24830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:49:14.728727 24830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:49:14.744652 24830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "30378fc16c3944119a9cc9aaa473878d"
format_stamp: "Formatted at 2026-08-07 22:49:14 on dist-test-slave-tm1g"
server_key: "9dfb23279722cf24b8d7721a6df8d9c3"
server_key_iv: "59cd4b944145ee1d19829bc5825a2689"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:14.745366 24830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "30378fc16c3944119a9cc9aaa473878d"
format_stamp: "Formatted at 2026-08-07 22:49:14 on dist-test-slave-tm1g"
server_key: "9dfb23279722cf24b8d7721a6df8d9c3"
server_key_iv: "59cd4b944145ee1d19829bc5825a2689"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:14.750286 24830 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 22:49:14.774830 24848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:49:14.776504 24830 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 22:49:14.776630 24830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "30378fc16c3944119a9cc9aaa473878d"
format_stamp: "Formatted at 2026-08-07 22:49:14 on dist-test-slave-tm1g"
server_key: "9dfb23279722cf24b8d7721a6df8d9c3"
server_key_iv: "59cd4b944145ee1d19829bc5825a2689"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:14.776763 24830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:49:14.802824 24830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:49:14.806501 24830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:49:14.806694 24830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:49:14.807535 24830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:49:14.808605 24830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:49:14.808674 24830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:49:14.808728 24830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:49:14.808756 24830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:49:14.821565 24830 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:39953
I20260807 22:49:14.822778 24830 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:49:14.824101 24966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:39953 every 8 connection(s)
I20260807 22:49:14.826508 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 24830
I20260807 22:49:14.826643 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:49:14.826974 12739 external_mini_cluster.cc:1428] Setting key b7d1090dbd08e50e92fd583047d2f3e9
Aug 07 22:49:14 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:49:14.847487 24682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.828172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:42629 (local address 127.12.112.254:36029)
0807 22:49:14.828294 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:14.828299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:14.828786 (+ 487us) server_negotiation.cc:407] Connection header received
0807 22:49:14.830030 (+ 1244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:14.830033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:14.830084 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:14.830131 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:49:14.831713 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.832524 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.834157 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.834514 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.834590 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.842877 (+ 8287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:49:14.842881 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:49:14.842884 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:49:14.842916 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:49:14.844723 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:49:14.845430 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:49:14.845435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:49:14.845437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:49:14.845529 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:49:14.845977 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:49:14.845981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:49:14.845983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:49:14.846226 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:49:14.846352 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:14.847175 (+ 823us) server_negotiation.cc:299] Negotiation successful
0807 22:49:14.847306 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:49:14.849205 24969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.827087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36029 (local address 127.12.112.195:42629)
0807 22:49:14.828637 (+ 1550us) negotiation.cc:107] Waiting for socket to connect
0807 22:49:14.828693 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 22:49:14.829719 (+ 1026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:49:14.830545 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:49:14.830553 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:49:14.830912 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:49:14.831555 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.831572 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.832706 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.832710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.834022 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.834032 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.834792 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.834796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.835001 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.837415 (+ 2414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:49:14.837436 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:49:14.842642 (+ 5206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:49:14.844869 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:49:14.844877 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:49:14.844898 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:49:14.845289 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:49:14.845652 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:49:14.845656 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:49:14.845659 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:49:14.845858 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:49:14.846440 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:49:14.846446 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:49:14.846858 (+ 412us) client_negotiation.cc:769] Sending connection context
0807 22:49:14.847722 (+ 864us) client_negotiation.cc:240] Negotiation successful
0807 22:49:14.848087 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1339,"thread_start_us":156,"threads_started":1}
I20260807 22:49:14.850498 24967 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36029
I20260807 22:49:14.850750 24967 heartbeater.cc:464] Registering TS with master...
I20260807 22:49:14.851368 24967 heartbeater.cc:511] Master 127.12.112.254:36029 requested a full tablet report, sending...
I20260807 22:49:14.853925 24455 ts_manager.cc:194] Registered new tserver with Master: 30378fc16c3944119a9cc9aaa473878d (127.12.112.195:39953)
I20260807 22:49:14.854727 24455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:42629
I20260807 22:49:14.865027 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:49:14.877818 24682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.867571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58830 (local address 127.12.112.254:36029)
0807 22:49:14.867691 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:14.867695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:14.868294 (+ 599us) server_negotiation.cc:407] Connection header received
0807 22:49:14.868499 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:14.868504 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:14.868552 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:14.868609 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:49:14.869626 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.870477 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.871808 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.872146 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.872236 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.874140 (+ 1904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:49:14.874144 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:49:14.874146 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:49:14.874175 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:49:14.876030 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:49:14.876519 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:49:14.876523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:49:14.876525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:49:14.876616 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:49:14.876918 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:49:14.876922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:49:14.876924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:49:14.877150 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:49:14.877289 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:14.877533 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 22:49:14.877652 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:49:14.881287 24455 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58830:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:49:14.885762 24455 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:49:14.901506 24983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.895481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38178 (local address 127.12.112.193:42215)
0807 22:49:14.895913 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:14.895920 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:14.896154 (+ 234us) server_negotiation.cc:407] Connection header received
0807 22:49:14.896279 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:14.896286 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:14.896496 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:14.897038 (+ 542us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:49:14.897173 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.898093 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.899792 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.900606 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.900700 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.900828 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:14.901246 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 22:49:14.901357 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":105,"threads_started":1}
I20260807 22:49:14.902014 24980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.894800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:42215 (local address 127.0.0.1:38178)
0807 22:49:14.896043 (+ 1243us) negotiation.cc:107] Waiting for socket to connect
0807 22:49:14.896053 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:49:14.896161 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:49:14.896670 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:49:14.896676 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:49:14.896701 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:49:14.896876 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.896884 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.898209 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.898215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.899655 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.899664 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.900925 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.900929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.901045 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.901082 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 22:49:14.901748 (+ 666us) client_negotiation.cc:240] Negotiation successful
0807 22:49:14.901871 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1194,"thread_start_us":97,"threads_started":1}
I20260807 22:49:14.903108 24981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.894706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:39953 (local address 127.0.0.1:39684)
0807 22:49:14.895654 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0807 22:49:14.895701 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 22:49:14.895830 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:49:14.897344 (+ 1514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:49:14.897347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:49:14.897368 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:49:14.897493 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.897499 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.898872 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.898875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.900686 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.900698 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.901991 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.901995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.902099 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.902122 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:49:14.902194 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 22:49:14.902985 (+ 791us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":771,"thread_start_us":94,"threads_started":1}
I20260807 22:49:14.903643 24984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.895515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39684 (local address 127.12.112.195:39953)
0807 22:49:14.896423 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:14.896434 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:14.896454 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:49:14.896523 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:14.896528 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:14.897170 (+ 642us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:14.897343 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:49:14.897640 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.898733 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.900866 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.901679 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.901798 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.901921 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:14.903406 (+ 1485us) server_negotiation.cc:299] Negotiation successful
0807 22:49:14.903504 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":136,"threads_started":1}
I20260807 22:49:14.903898 24985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.896161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:40185 (local address 127.0.0.1:58388)
0807 22:49:14.898346 (+ 2185us) negotiation.cc:107] Waiting for socket to connect
0807 22:49:14.898361 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:49:14.898451 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:49:14.899101 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:49:14.899103 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:49:14.899119 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:49:14.899238 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.899243 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.900585 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.900589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.901928 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:14.901938 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.903354 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.903357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:14.903454 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.903478 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:49:14.903541 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 22:49:14.903605 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2108,"thread_start_us":89,"threads_started":1}
I20260807 22:49:14.904661 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:14.896692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58388 (local address 127.12.112.194:40185)
0807 22:49:14.897617 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:14.897627 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:14.898541 (+ 914us) server_negotiation.cc:407] Connection header received
0807 22:49:14.898620 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:14.898626 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:14.898796 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:14.898960 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:49:14.899361 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.900449 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.902272 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:14.903039 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:14.903156 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:14.904383 (+ 1227us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:14.904436 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 22:49:14.904525 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":830,"thread_start_us":141,"threads_started":1}
I20260807 22:49:14.905366 24600 tablet_service.cc:1467] Processing CreateTablet for tablet f130f7553dbe4a6c81eac1cff12978b6 (DEFAULT_TABLE table=test-table [id=a07109ce25cb4c719a82914969dc94a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:49:14.906136 24898 tablet_service.cc:1467] Processing CreateTablet for tablet f130f7553dbe4a6c81eac1cff12978b6 (DEFAULT_TABLE table=test-table [id=a07109ce25cb4c719a82914969dc94a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:49:14.906607 24600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f130f7553dbe4a6c81eac1cff12978b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:49:14.907161 24898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f130f7553dbe4a6c81eac1cff12978b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:49:14.907497 24755 tablet_service.cc:1467] Processing CreateTablet for tablet f130f7553dbe4a6c81eac1cff12978b6 (DEFAULT_TABLE table=test-table [id=a07109ce25cb4c719a82914969dc94a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:49:14.908401 24755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f130f7553dbe4a6c81eac1cff12978b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:49:14.912873 24987 tablet_bootstrap.cc:492] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933: Bootstrap starting.
I20260807 22:49:14.914750 24989 tablet_bootstrap.cc:492] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: Bootstrap starting.
I20260807 22:49:14.915320 24987 tablet_bootstrap.cc:654] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933: Neither blocks nor log segments found. Creating new log.
I20260807 22:49:14.916558 24987 log.cc:824] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933: Log is configured to *not* fsync() on all Append() calls
I20260807 22:49:14.916426 24990 tablet_bootstrap.cc:492] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: Bootstrap starting.
I20260807 22:49:14.917495 24989 tablet_bootstrap.cc:654] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: Neither blocks nor log segments found. Creating new log.
I20260807 22:49:14.918355 24989 log.cc:824] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: Log is configured to *not* fsync() on all Append() calls
I20260807 22:49:14.919059 24987 tablet_bootstrap.cc:492] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933: No bootstrap required, opened a new log
I20260807 22:49:14.919241 24987 ts_tablet_manager.cc:1397] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260807 22:49:14.919344 24990 tablet_bootstrap.cc:654] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: Neither blocks nor log segments found. Creating new log.
I20260807 22:49:14.920055 24990 log.cc:824] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: Log is configured to *not* fsync() on all Append() calls
I20260807 22:49:14.920382 24989 tablet_bootstrap.cc:492] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: No bootstrap required, opened a new log
I20260807 22:49:14.920545 24989 ts_tablet_manager.cc:1397] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:49:14.923831 24987 raft_consensus.cc:348] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 } } peers { permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 } } peers { permanent_uuid: "dd33d0cf216648ffa0ee1a468e441172" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 40185 } }
I20260807 22:49:14.924193 24987 raft_consensus.cc:374] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:49:14.924290 24987 raft_consensus.cc:729] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27211ad560df42f69400118b3b972933, State: Initialized, Role: FOLLOWER
I20260807 22:49:14.924343 24989 raft_consensus.cc:348] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 } } peers { permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 } } peers { permanent_uuid: "dd33d0cf216648ffa0ee1a468e441172" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 40185 } }
I20260807 22:49:14.924577 24989 raft_consensus.cc:374] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:49:14.924638 24989 raft_consensus.cc:729] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30378fc16c3944119a9cc9aaa473878d, State: Initialized, Role: FOLLOWER
I20260807 22:49:14.925021 24990 tablet_bootstrap.cc:492] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: No bootstrap required, opened a new log
I20260807 22:49:14.925024 24989 consensus_queue.cc:260] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 } } peers { permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 } } peers { permanent_uuid: "dd33d0cf216648ffa0ee1a468e441172" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 40185 } }
I20260807 22:49:14.924988 24987 consensus_queue.cc:260] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 } } peers { permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 } } peers { permanent_uuid: "dd33d0cf216648ffa0ee1a468e441172" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 40185 } }
I20260807 22:49:14.925201 24990 ts_tablet_manager.cc:1397] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260807 22:49:14.926038 24987 ts_tablet_manager.cc:1428] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260807 22:49:14.926038 24989 ts_tablet_manager.cc:1428] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260807 22:49:14.926399 24679 heartbeater.cc:503] Master 127.12.112.254:36029 was elected leader, sending a full tablet report...
I20260807 22:49:14.926399 24967 heartbeater.cc:503] Master 127.12.112.254:36029 was elected leader, sending a full tablet report...
I20260807 22:49:14.929497 24990 raft_consensus.cc:348] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 } } peers { permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 } } peers { permanent_uuid: "dd33d0cf216648ffa0ee1a468e441172" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 40185 } }
I20260807 22:49:14.929766 24990 raft_consensus.cc:374] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:49:14.929823 24990 raft_consensus.cc:729] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd33d0cf216648ffa0ee1a468e441172, State: Initialized, Role: FOLLOWER
I20260807 22:49:14.930336 24990 consensus_queue.cc:260] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 } } peers { permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 } } peers { permanent_uuid: "dd33d0cf216648ffa0ee1a468e441172" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 40185 } }
I20260807 22:49:14.931046 24825 heartbeater.cc:503] Master 127.12.112.254:36029 was elected leader, sending a full tablet report...
I20260807 22:49:14.932185 24990 ts_tablet_manager.cc:1428] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260807 22:49:14.972703 24680 tablet.cc:2369] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:49:14.999737 24826 tablet.cc:2369] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 22:49:15 dist-test-slave-tm1g krb5kdc[23949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
W20260807 22:49:15.078600 24968 tablet.cc:2369] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:49:15.237332 24996 raft_consensus.cc:482] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:49:15.237592 24996 raft_consensus.cc:504] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 } } peers { permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 } } peers { permanent_uuid: "dd33d0cf216648ffa0ee1a468e441172" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 40185 } }
I20260807 22:49:15.238986 24996 leader_election.cc:288] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30378fc16c3944119a9cc9aaa473878d (127.12.112.195:39953), 27211ad560df42f69400118b3b972933 (127.12.112.193:42215)
I20260807 22:49:15.252858 24984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:15.240505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:34429 (local address 127.12.112.195:39953)
0807 22:49:15.240644 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:15.240649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:15.248102 (+ 7453us) server_negotiation.cc:407] Connection header received
0807 22:49:15.248308 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:15.248312 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:15.248363 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:15.248413 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:49:15.248857 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:15.249653 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:15.251519 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:15.252121 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:15.252216 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:15.252267 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:15.252633 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 22:49:15.252715 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:49:15.253332 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:15.240173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:39953 (local address 127.12.112.194:34429)
0807 22:49:15.247980 (+ 7807us) negotiation.cc:107] Waiting for socket to connect
0807 22:49:15.247995 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:49:15.248176 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:49:15.248566 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:49:15.248571 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:49:15.248595 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:49:15.248727 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:15.248734 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:15.250051 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:15.250055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:15.251376 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:15.251387 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:15.252375 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:15.252379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:15.252500 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:15.252521 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:49:15.253080 (+ 559us) client_negotiation.cc:240] Negotiation successful
0807 22:49:15.253159 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7737,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260807 22:49:15.254580 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f130f7553dbe4a6c81eac1cff12978b6" candidate_uuid: "dd33d0cf216648ffa0ee1a468e441172" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30378fc16c3944119a9cc9aaa473878d" is_pre_election: true
I20260807 22:49:15.254968 24907 raft_consensus.cc:2454] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd33d0cf216648ffa0ee1a468e441172 in term 0.
I20260807 22:49:15.255697 24708 leader_election.cc:302] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30378fc16c3944119a9cc9aaa473878d, dd33d0cf216648ffa0ee1a468e441172; no voters:
I20260807 22:49:15.256049 24996 raft_consensus.cc:2781] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:49:15.256132 24996 raft_consensus.cc:482] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:49:15.256176 24996 raft_consensus.cc:3037] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:49:15.257573 24996 raft_consensus.cc:504] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 } } peers { permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 } } peers { permanent_uuid: "dd33d0cf216648ffa0ee1a468e441172" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 40185 } }
I20260807 22:49:15.257972 24996 leader_election.cc:288] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [CANDIDATE]: Term 1 election: Requested vote from peers 30378fc16c3944119a9cc9aaa473878d (127.12.112.195:39953), 27211ad560df42f69400118b3b972933 (127.12.112.193:42215)
I20260807 22:49:15.259608 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f130f7553dbe4a6c81eac1cff12978b6" candidate_uuid: "dd33d0cf216648ffa0ee1a468e441172" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30378fc16c3944119a9cc9aaa473878d"
I20260807 22:49:15.259745 24907 raft_consensus.cc:3037] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:49:15.261303 24907 raft_consensus.cc:2454] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd33d0cf216648ffa0ee1a468e441172 in term 1.
I20260807 22:49:15.261778 24708 leader_election.cc:302] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30378fc16c3944119a9cc9aaa473878d, dd33d0cf216648ffa0ee1a468e441172; no voters:
I20260807 22:49:15.262023 24996 raft_consensus.cc:2781] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:49:15.262234 24996 raft_consensus.cc:686] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 1 LEADER]: Becoming Leader. State: Replica: dd33d0cf216648ffa0ee1a468e441172, State: Running, Role: LEADER
I20260807 22:49:15.262634 24996 consensus_queue.cc:237] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 } } peers { permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 } } peers { permanent_uuid: "dd33d0cf216648ffa0ee1a468e441172" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 40185 } }
I20260807 22:49:15.266112 24983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:15.239786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:58893 (local address 127.12.112.193:42215)
0807 22:49:15.239957 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:15.239962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:15.245216 (+ 5254us) server_negotiation.cc:407] Connection header received
0807 22:49:15.245466 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:15.245470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:15.245524 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:15.245576 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:49:15.251087 (+ 5511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:15.251833 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:15.263779 (+ 11946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:15.264473 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:15.264607 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:15.264666 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:15.265882 (+ 1216us) server_negotiation.cc:299] Negotiation successful
0807 22:49:15.265983 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 22:49:15.266634 24999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:15.239401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:42215 (local address 127.12.112.194:58893)
0807 22:49:15.245109 (+ 5708us) negotiation.cc:107] Waiting for socket to connect
0807 22:49:15.245125 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:49:15.245325 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:49:15.250763 (+ 5438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:49:15.250766 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:49:15.250786 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:49:15.250920 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:15.250927 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:15.252003 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:15.252007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:15.263638 (+ 11631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:49:15.263651 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:49:15.265592 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:49:15.265596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:49:15.265708 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:15.265739 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 22:49:15.266264 (+ 525us) client_negotiation.cc:240] Negotiation successful
0807 22:49:15.266375 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5620,"thread_start_us":92,"threads_started":1}
I20260807 22:49:15.267390 24629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f130f7553dbe4a6c81eac1cff12978b6" candidate_uuid: "dd33d0cf216648ffa0ee1a468e441172" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27211ad560df42f69400118b3b972933" is_pre_election: true
I20260807 22:49:15.267686 24629 raft_consensus.cc:2454] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd33d0cf216648ffa0ee1a468e441172 in term 0.
I20260807 22:49:15.267992 24628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f130f7553dbe4a6c81eac1cff12978b6" candidate_uuid: "dd33d0cf216648ffa0ee1a468e441172" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27211ad560df42f69400118b3b972933"
I20260807 22:49:15.268086 24628 raft_consensus.cc:3037] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:49:15.269409 24628 raft_consensus.cc:2454] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd33d0cf216648ffa0ee1a468e441172 in term 1.
I20260807 22:49:15.270447 24455 catalog_manager.cc:5495] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd33d0cf216648ffa0ee1a468e441172 (127.12.112.194). New cstate: current_term: 1 leader_uuid: "dd33d0cf216648ffa0ee1a468e441172" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd33d0cf216648ffa0ee1a468e441172" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 40185 } health_report { overall_health: HEALTHY } } }
I20260807 22:49:15.356170 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:15.352061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58394 (local address 127.12.112.194:40185)
0807 22:49:15.352226 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 22:49:15.352231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:49:15.352255 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:49:15.352418 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:49:15.352421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:49:15.352487 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:49:15.352602 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:49:15.352866 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:15.353395 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:15.354457 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:49:15.354747 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:49:15.354874 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:49:15.355218 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:49:15.355757 (+ 539us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:49:15.355887 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 22:49:15.355950 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 22:49:15.356015 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:49:15.362185 24628 raft_consensus.cc:1261] T f130f7553dbe4a6c81eac1cff12978b6 P 27211ad560df42f69400118b3b972933 [term 1 FOLLOWER]: Refusing update from remote peer dd33d0cf216648ffa0ee1a468e441172: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:49:15.362185 24907 raft_consensus.cc:1261] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d [term 1 FOLLOWER]: Refusing update from remote peer dd33d0cf216648ffa0ee1a468e441172: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:49:15.362960 25001 consensus_queue.cc:1035] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30378fc16c3944119a9cc9aaa473878d" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 39953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:49:15.363155 24996 consensus_queue.cc:1035] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27211ad560df42f69400118b3b972933" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:49:15.370651 25012 mvcc.cc:205] Tried to move back new op lower bound from 7316041545155833856 to 7316041544759517184. Current Snapshot: MvccSnapshot[applied={T|T < 7316041545155833856}]
I20260807 22:49:15.374434 25014 mvcc.cc:205] Tried to move back new op lower bound from 7316041545155833856 to 7316041544759517184. Current Snapshot: MvccSnapshot[applied={T|T < 7316041545155833856}]
I20260807 22:49:15.379601 25013 mvcc.cc:205] Tried to move back new op lower bound from 7316041545155833856 to 7316041544759517184. Current Snapshot: MvccSnapshot[applied={T|T < 7316041545155833856}]
I20260807 22:49:15.383917 24455 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:49:15.384106 24455 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:49:15.386454 24455 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49be3dae64ea40419b4c4da7980db6e1: Sending DeleteTablet for 3 replicas of tablet f130f7553dbe4a6c81eac1cff12978b6
I20260807 22:49:15.387276 24898 tablet_service.cc:1514] Processing DeleteTablet for tablet f130f7553dbe4a6c81eac1cff12978b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:49:15 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:39684
I20260807 22:49:15.387429 24600 tablet_service.cc:1514] Processing DeleteTablet for tablet f130f7553dbe4a6c81eac1cff12978b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:49:15 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:38178
I20260807 22:49:15.388186 24755 tablet_service.cc:1514] Processing DeleteTablet for tablet f130f7553dbe4a6c81eac1cff12978b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:49:15 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:58388
I20260807 22:49:15.388797 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 24539
I20260807 22:49:15.392299 25024 tablet_replica.cc:330] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: stopping tablet replica
I20260807 22:49:15.392604 25024 raft_consensus.cc:2229] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:49:15.393015 25024 raft_consensus.cc:2258] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:49:15.394690 25024 ts_tablet_manager.cc:1905] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:49:15.398361 25021 tablet_replica.cc:330] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: stopping tablet replica
I20260807 22:49:15.398370 25024 ts_tablet_manager.cc:1918] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:49:15.398564 25024 log.cc:1196] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/f130f7553dbe4a6c81eac1cff12978b6
I20260807 22:49:15.398710 25021 raft_consensus.cc:2229] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:49:15.399047 25024 ts_tablet_manager.cc:1939] T f130f7553dbe4a6c81eac1cff12978b6 P dd33d0cf216648ffa0ee1a468e441172: Deleting consensus metadata
I20260807 22:49:15.399058 25021 raft_consensus.cc:2258] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 22:49:15.400918 24439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:42215 (error 108)
I20260807 22:49:15.401588 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 24687
I20260807 22:49:15.401894 24980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:15.401595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:42215 (local address 127.0.0.1:38194)
0807 22:49:15.401725 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 22:49:15.401809 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:42215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 22:49:15.402048 24439 catalog_manager.cc:4584] TS 27211ad560df42f69400118b3b972933 (127.12.112.193:42215): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f130f7553dbe4a6c81eac1cff12978b6: Network error: Client connection negotiation failed: client connection to 127.12.112.193:42215: connect: Connection refused (error 111)
I20260807 22:49:15.400738 25021 ts_tablet_manager.cc:1905] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:49:15.406275 25021 ts_tablet_manager.cc:1918] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:49:15.406420 25021 log.cc:1196] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/f130f7553dbe4a6c81eac1cff12978b6
I20260807 22:49:15.406720 25021 ts_tablet_manager.cc:1939] T f130f7553dbe4a6c81eac1cff12978b6 P 30378fc16c3944119a9cc9aaa473878d: Deleting consensus metadata
I20260807 22:49:15.407949 24441 catalog_manager.cc:4841] TS 30378fc16c3944119a9cc9aaa473878d (127.12.112.195:39953): tablet f130f7553dbe4a6c81eac1cff12978b6 (table test-table [id=a07109ce25cb4c719a82914969dc94a8]) successfully deleted
I20260807 22:49:15.413645 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 24830
I20260807 22:49:15.416018 24980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:49:15.415695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:40185 (local address 127.0.0.1:58398)
0807 22:49:15.415863 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 22:49:15.415927 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.194:40185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 22:49:15.420605 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 24421
I20260807 22:49:15.429697 12739 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 22:49:15.775100 12739 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 22:49:15.775218 12739 mini_ranger.cc:66] Stopping Ranger...
I20260807 22:49:16.120139 12739 mini_ranger.cc:68] Stopped Ranger
2026-08-07 22:49:16.120 UTC [23979] LOG: received smart shutdown request
2026-08-07 22:49:16.123 UTC [23979] LOG: background worker "logical replication launcher" (PID 23990) exited with exit code 1
2026-08-07 22:49:16.124 UTC [23984] LOG: shutting down
2026-08-07 22:49:16.285 UTC [23979] LOG: database system is shut down
2026-08-07T22:49:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46792 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:49:16 dist-test-slave-tm1g krb5kdc[25035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:49:16 dist-test-slave-tm1g krb5kdc[25035](info): set up 2 sockets
Aug 07 22:49:16 dist-test-slave-tm1g krb5kdc[25035](info): commencing operation
krb5kdc: starting...
W20260807 22:49:17.469667 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:49:17 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:49:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:49:17Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.112.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.112.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/rangeradmin_127.12.112.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/rangeradmin_127.12.112.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.112.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.112.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/rangerlookup_127.12.112.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/rangerlookup_127.12.112.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.112.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.112.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/HTTP_127.12.112.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/HTTP_127.12.112.212@KRBTEST.COM.keytab.
I20260807 22:49:17.648305 12739 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasksZtO5S/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/postgres -l logfile start
2026-08-07 22:49:20.089 UTC [25066] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 22:49:20.089 UTC [25066] LOG: listening on IPv4 address "127.12.112.212", port 55441
2026-08-07 22:49:20.092 UTC [25066] LOG: listening on Unix socket "/tmp/.s.PGSQL.55441"
2026-08-07 22:49:20.127 UTC [25069] LOG: database system was shut down at 2026-08-07 22:49:18 UTC
2026-08-07 22:49:20.131 UTC [25066] LOG: database system is ready to accept connections
I20260807 22:49:21.097581 12739 mini_postgres.cc:96] Postgres bound to 55441
2026-08-07 22:49:21.104 UTC [25078] FATAL: database "slave" does not exist
127.12.112.212:55441 - accepting connections
I20260807 22:49:21.105329 12739 mini_ranger.cc:161] Starting Ranger...
I20260807 22:49:21.120788 12739 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 22:49:21.588465 12739 mini_ranger.cc:87] Created ranger Postgres database
I20260807 22:49:21.588554 12739 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-admin
2026-08-07 22:49:21,858 [I] DB FLAVOR :POSTGRES
2026-08-07 22:49:21,859 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:49:21,859 [I] Checking connection..
2026-08-07 22:49:21,859 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 22:49:22,124 [I] Checking connection passed.
2026-08-07 22:49:22,125 [I] --------- Verifying version history table ---------
2026-08-07 22:49:22,125 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:49:22,377 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:49:22,378 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:49:22,619 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:49:22,619 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 22:49:22,619 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 22:49:22.878 UTC [25150] WARNING: there is no transaction in progress
2026-08-07 22:49:22,885 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 22:49:22,885 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:49:23,149 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 22:49:23,149 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:49:23,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 22:49:23,402 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 22:49:23,645 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-tm1g.c.gcp-upstream.internal','N') ;"
2026-08-07 22:49:23,898 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:49:24,157 [I] Table x_portal_user does not exist in database ranger
2026-08-07 22:49:24,158 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:49:24,420 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 22:49:24,420 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:49:24,670 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:49:24,922 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 22:49:24,922 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 22:49:25.836 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:25.852 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:25.867 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:25.881 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:25.897 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:25.915 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:25.979 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:25.985 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:25.998 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:26.008 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:26.018 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:26.031 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:26.040 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:26.046 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:26.053 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:26.059 UTC [25264] WARNING: there is no transaction in progress
2026-08-07 22:49:26,652 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 22:49:26,652 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 22:49:26,910 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 22:49:26,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:49:27,203 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 22:49:27,203 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:49:27,460 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 22:49:27,461 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:49:27,726 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:49:27,991 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-tm1g.c.gcp-upstream.internal';"
2026-08-07 22:49:28,225 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 22:49:28,225 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 22:49:28,486 [I] DB_PATCHES have already been applied
I20260807 22:49:28.491705 12739 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-admin:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasksZtO5S/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 22:49:28.491771 12739 mini_ranger.cc:193] Using host: 127.12.112.212
I20260807 22:49:28.495831 12739 mini_ranger.cc:227] Ranger admin URL: http://127.12.112.212:50281
Aug 07, 2026 10:49:28 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:49:28 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:49:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 10:49:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 10:49:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 10:49:29 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 10:49:29 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 22:49:29.623566 12739 mini_ranger.cc:160] Time spent starting Ranger: real 8.518s user 0.001s sys 0.010s
Aug 07, 2026 10:49:49 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 10:49:50 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Aug 07, 2026 10:49:50 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 10:49:50 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 10:49:51 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 22:49:51.612231 12739 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.112.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.112.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/rangerkms_127.12.112.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.112.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/rangerkms_127.12.112.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.112.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.112.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.112.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/HTTP_127.12.112.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.112.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/HTTP_127.12.112.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 22:49:51 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142991, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 22:49:51.717710 12739 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 22:49:51.728480 12739 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 22:49:52.564014 12739 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 22:49:52.564086 12739 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-kms
I20260807 22:49:52.564100 12739 mini_ranger_kms.cc:227] Using postgres at 127.12.112.212:55441
2026-08-07 22:49:52,742 [I] DB FLAVOR :POSTGRES
2026-08-07 22:49:52,743 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:49:52,743 [I] Checking connection
2026-08-07 22:49:52,743 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 22:49:52,993 [I] connection success
2026-08-07 22:49:52,994 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 22:49:52,994 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 22:49:52,994 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 22:49:53,229 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 22:49:53,229 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:49:53,229 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 22:49:53,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.112.212:55441/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 22:49:53,479 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 22:49:53.931159 12739 mini_ranger_kms.cc:310] Created kms service
I20260807 22:49:54.109601 12739 mini_ranger_kms.cc:326] Created kudu user
I20260807 22:49:54.153798 12739 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 22:49:54 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142991, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:49:54.554397 12739 mini_ranger_kms.cc:384] Added ranger policy
I20260807 22:49:54.554664 12739 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-kms:/tmp/dist-test-tasksZtO5S/build/debug/bin/postgresql.jar:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasksZtO5S/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 22:49:54.554701 12739 mini_ranger_kms.cc:240] Using host: 127.12.112.212
I20260807 22:49:54.559513 12739 mini_ranger_kms.cc:276] Ranger KMS PID: 25463
I20260807 22:49:54.559598 12739 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.112.212:46891
Aug 07, 2026 10:49:55 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:49:55 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:49:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 10:49:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 10:49:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 10:49:56 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 22:49:56 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142996, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.112.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:49:56.876837 12739 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.159s user 0.005s sys 0.158s
I20260807 22:49:56.876963 12739 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 22:49:56.877032 12739 mini_ranger_kms.cc:401] 127.12.112.212:46891/kms/v1/keys
Aug 07 22:49:57 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142996, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.112.212@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
Aug 07 22:49:57 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142996, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.112.212@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
Aug 07 22:49:59 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:49:59.799280 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:34141
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:34141
--ranger_config_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:46891/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:49:59.911693 25519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:49:59.911968 25519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:49:59.912045 25519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:49:59.916041 25519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:49:59.916122 25519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:49:59.916160 25519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:49:59.916219 25519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:49:59.916257 25519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:49:59.921615 25519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.112.212:46891/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:34141
--ranger_config_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:34141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:49:59.922765 25519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:49:59.923777 25519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:49:59.933736 25524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:49:59.933908 25519 server_base.cc:1034] running on GCE node
W20260807 22:49:59.933773 25525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:49:59.934172 25527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:49:59.934764 25519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:49:59.935832 25519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:49:59.937018 25519 hybrid_clock.cc:648] HybridClock initialized: now 1786142999937004 us; error 35 us; skew 500 ppm
Aug 07 22:49:59 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142999, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:49:59.940163 25519 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:49:59.941248 25519 webserver.cc:460] Webserver started at http://127.12.112.254:33155/ using document root <none> and password file <none>
I20260807 22:49:59.941886 25519 fs_manager.cc:359] Metadata directory not provided
I20260807 22:49:59.941963 25519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:49:59.942178 25519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:49:59 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142999, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:49:59.996711 25519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "cfc3f6e4aa594f8d9764818567b4028a"
format_stamp: "Formatted at 2026-08-07 22:49:59 on dist-test-slave-tm1g"
server_key: "6a9f29c90544b3d87bc09bb64125b36f"
server_key_iv: "fa20a43701caa33e37393725044b1a62"
server_key_version: "kuduclusterkey@0"
I20260807 22:49:59.997359 25519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "cfc3f6e4aa594f8d9764818567b4028a"
format_stamp: "Formatted at 2026-08-07 22:49:59 on dist-test-slave-tm1g"
server_key: "6a9f29c90544b3d87bc09bb64125b36f"
server_key_iv: "fa20a43701caa33e37393725044b1a62"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:00.001415 25519 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 22:50:00.015676 25534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:00.017076 25519 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:50:00.017218 25519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "cfc3f6e4aa594f8d9764818567b4028a"
format_stamp: "Formatted at 2026-08-07 22:49:59 on dist-test-slave-tm1g"
server_key: "6a9f29c90544b3d87bc09bb64125b36f"
server_key_iv: "fa20a43701caa33e37393725044b1a62"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:00.017359 25519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:00.028575 25519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:00.031502 25519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:00.031694 25519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:00.039753 25519 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:34141
I20260807 22:50:00.039762 25591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:34141 every 8 connection(s)
I20260807 22:50:00.040854 25519 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:50:00.043665 25592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:00.046721 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 25519
I20260807 22:50:00.046861 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:50:00.047196 12739 external_mini_cluster.cc:1428] Setting key 40b503e32f6e99f251eab19c6b0f9945
I20260807 22:50:00.050001 25592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: Bootstrap starting.
I20260807 22:50:00.052531 25592 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:00.053257 25592 log.cc:824] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:00.055368 25592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: No bootstrap required, opened a new log
Aug 07 22:50:00 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:00.059609 25592 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } }
I20260807 22:50:00.059896 25592 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:00.060010 25592 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc3f6e4aa594f8d9764818567b4028a, State: Initialized, Role: FOLLOWER
I20260807 22:50:00.060521 25592 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } }
I20260807 22:50:00.060680 25592 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:50:00.060786 25592 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:50:00.060906 25592 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:00.061944 25592 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } }
I20260807 22:50:00.062352 25592 leader_election.cc:302] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfc3f6e4aa594f8d9764818567b4028a; no voters:
I20260807 22:50:00.062705 25592 leader_election.cc:288] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:50:00.063005 25599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:50:00.063223 25599 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 1 LEADER]: Becoming Leader. State: Replica: cfc3f6e4aa594f8d9764818567b4028a, State: Running, Role: LEADER
I20260807 22:50:00.063580 25599 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } }
I20260807 22:50:00.064076 25597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:00.048665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34788 (local address 127.12.112.254:34141)
0807 22:50:00.049114 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:00.049131 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:00.049174 (+ 43us) server_negotiation.cc:407] Connection header received
0807 22:50:00.049998 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:00.050021 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:00.050461 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:00.050840 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:00.051748 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:00.053343 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:00.054412 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:00.055108 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:00.055276 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:00.058525 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:00.058532 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:00.058548 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:00.058578 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:00.060604 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:00.061143 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:00.061149 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:00.061156 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:00.061297 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:00.061620 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:00.061623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:00.061625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:00.062122 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:00.062347 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:00.062667 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 22:50:00.062947 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":129,"threads_started":1}
I20260807 22:50:00.064378 25592 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:50:00.066257 25599 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfc3f6e4aa594f8d9764818567b4028a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } } }
I20260807 22:50:00.066500 25599 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:00.066670 25592 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 22:50:00.067056 25599 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfc3f6e4aa594f8d9764818567b4028a. Latest consensus state: current_term: 1 leader_uuid: "cfc3f6e4aa594f8d9764818567b4028a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } } }
I20260807 22:50:00.067149 25599 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:00.067292 25614 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:50:00.074950 25614 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:50:00.084077 25614 catalog_manager.cc:1347] Generated new cluster ID: bdd1ef44364a4d41ae99726c70ef4309
I20260807 22:50:00.084141 25614 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:50:00.102084 25614 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:50:00.103488 25614 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:50:00.114853 25614 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: Generated new TSK 0
I20260807 22:50:00.115801 25614 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:50:00.759796 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:46891/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34141
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:00.878486 25642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:00.878754 25642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:00.878823 25642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:00.882948 25642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:00.883026 25642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:00.883112 25642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:50:00.888513 25642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.112.212:46891/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:00.889622 25642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:00.890725 25642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:00.900492 25649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:00.900804 25652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:00.900950 25650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:00.901378 25642 server_base.cc:1034] running on GCE node
I20260807 22:50:00.901803 25642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:00.902570 25642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:00.903764 25642 hybrid_clock.cc:648] HybridClock initialized: now 1786143000903746 us; error 34 us; skew 500 ppm
Aug 07 22:50:00 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143000, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:00.906869 25642 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:50:00.907824 25642 webserver.cc:460] Webserver started at http://127.12.112.193:42693/ using document root <none> and password file <none>
I20260807 22:50:00.908390 25642 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:00.908483 25642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:00.908720 25642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:50:00 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143000, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:50:00.923857 25642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "31367bcac3794354a324c41b9777bf4e"
format_stamp: "Formatted at 2026-08-07 22:50:00 on dist-test-slave-tm1g"
server_key: "254ba28b76583783e23c066171b269e5"
server_key_iv: "3d87225142caff21b5d4261b3d879b5e"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:00.924489 25642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "31367bcac3794354a324c41b9777bf4e"
format_stamp: "Formatted at 2026-08-07 22:50:00 on dist-test-slave-tm1g"
server_key: "254ba28b76583783e23c066171b269e5"
server_key_iv: "3d87225142caff21b5d4261b3d879b5e"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:00.929970 25642 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 22:50:00.946521 25661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:00.947940 25642 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:50:00.948086 25642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "31367bcac3794354a324c41b9777bf4e"
format_stamp: "Formatted at 2026-08-07 22:50:00 on dist-test-slave-tm1g"
server_key: "254ba28b76583783e23c066171b269e5"
server_key_iv: "3d87225142caff21b5d4261b3d879b5e"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:00.948232 25642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:00.990242 25642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:00.994093 25642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:00.994414 25642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:00.995195 25642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:00.996304 25642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:00.996433 25642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:00.996558 25642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:00.996639 25642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:01.007926 25642 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:35671
I20260807 22:50:01.007952 25788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:35671 every 8 connection(s)
I20260807 22:50:01.008914 25642 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:50:01.009433 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 25642
I20260807 22:50:01.009563 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:50:01.009938 12739 external_mini_cluster.cc:1428] Setting key 0f6188a15c721da9c8162c4b5b9843cf
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143000, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:50:01.029196 25791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:01.012687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34141 (local address 127.12.112.193:47113)
0807 22:50:01.014360 (+ 1673us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:01.014425 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:01.015593 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:01.016233 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:01.016244 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:01.016597 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:01.017278 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:01.017299 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.018609 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.018614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:01.020182 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:01.020193 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.021124 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.021128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:01.021339 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:01.022096 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:01.022117 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:01.023880 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:01.026115 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:01.026121 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:01.026136 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:01.026522 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:01.026860 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:01.026863 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:01.026865 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:01.027039 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:01.027638 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:01.027645 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:01.027945 (+ 300us) client_negotiation.cc:769] Sending connection context
0807 22:50:01.028149 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 22:50:01.028453 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1439,"thread_start_us":155,"threads_started":1}
I20260807 22:50:01.030153 25793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:01.013737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:47113 (local address 127.12.112.254:34141)
0807 22:50:01.014103 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:01.014110 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:01.015874 (+ 1764us) server_negotiation.cc:407] Connection header received
0807 22:50:01.015912 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:01.015914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:01.015956 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:01.016058 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:01.017453 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.018451 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.020395 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.020816 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.020933 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:01.024049 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:01.024053 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:01.024056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:01.024081 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:01.025961 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:01.026655 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:01.026659 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:01.026661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:01.026754 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:01.027172 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:01.027176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:01.027178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:01.027485 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:01.027581 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:01.029776 (+ 2195us) server_negotiation.cc:299] Negotiation successful
0807 22:50:01.029927 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":113,"threads_started":1}
I20260807 22:50:01.031235 25789 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34141
I20260807 22:50:01.031481 25789 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:01.032038 25789 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
I20260807 22:50:01.033713 25554 ts_manager.cc:194] Registered new tserver with Master: 31367bcac3794354a324c41b9777bf4e (127.12.112.193:35671)
I20260807 22:50:01.035413 25554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:47113
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:50:01.058444 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:46891/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34141
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786143001, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 22:50:01.225790 25795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:01.226542 25795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:01.226675 25795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:01.232753 25795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:01.232867 25795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:01.232995 25795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:50:01.240821 25795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.112.212:46891/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:01.242360 25795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:01.243711 25795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:01.256019 25803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:01.256052 25805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:01.256040 25807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:01.256783 25795 server_base.cc:1034] running on GCE node
I20260807 22:50:01.257198 25795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:01.257908 25795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:01.259063 25795 hybrid_clock.cc:648] HybridClock initialized: now 1786143001258993 us; error 87 us; skew 500 ppm
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143001, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:01.262702 25795 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:50:01.263777 25795 webserver.cc:460] Webserver started at http://127.12.112.194:36263/ using document root <none> and password file <none>
I20260807 22:50:01.264521 25795 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:01.264607 25795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:01.264900 25795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143001, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:50:01.280795 25795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "936298ec636b408387fe0b6b55b6500c"
format_stamp: "Formatted at 2026-08-07 22:50:01 on dist-test-slave-tm1g"
server_key: "2ce11b92a2ef60fbf0666cd7e119e5c3"
server_key_iv: "86fa73b6b052ff6b57345700be836fd9"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:01.282356 25795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "936298ec636b408387fe0b6b55b6500c"
format_stamp: "Formatted at 2026-08-07 22:50:01 on dist-test-slave-tm1g"
server_key: "2ce11b92a2ef60fbf0666cd7e119e5c3"
server_key_iv: "86fa73b6b052ff6b57345700be836fd9"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:01.296283 25795 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.000s sys 0.004s
I20260807 22:50:01.316802 25815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:01.318599 25795 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:50:01.318734 25795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "936298ec636b408387fe0b6b55b6500c"
format_stamp: "Formatted at 2026-08-07 22:50:01 on dist-test-slave-tm1g"
server_key: "2ce11b92a2ef60fbf0666cd7e119e5c3"
server_key_iv: "86fa73b6b052ff6b57345700be836fd9"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:01.318879 25795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:01.350242 25795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:01.353921 25795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:01.354202 25795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:01.355020 25795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:01.356117 25795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:01.356231 25795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:01.356344 25795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:01.356418 25795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:01.368219 25795 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:35187
I20260807 22:50:01.369405 25795 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:50:01.370532 25938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:35187 every 8 connection(s)
I20260807 22:50:01.378175 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 25795
I20260807 22:50:01.378326 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:50:01.378648 12739 external_mini_cluster.cc:1428] Setting key 06cb31b888c54ad1da4c46fdcb33cfe9
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143001, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:01.393821 25793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:01.375993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:33171 (local address 127.12.112.254:34141)
0807 22:50:01.376126 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:01.376131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:01.377796 (+ 1665us) server_negotiation.cc:407] Connection header received
0807 22:50:01.380281 (+ 2485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:01.380285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:01.380339 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:01.380396 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:01.382070 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.382975 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.384690 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.385035 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.385115 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:01.389420 (+ 4305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:01.389424 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:01.389426 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:01.389464 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:01.391202 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:01.391840 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:01.391846 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:01.391851 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:01.391951 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:01.392380 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:01.392386 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:01.392390 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:01.392662 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:01.392748 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:01.393506 (+ 758us) server_negotiation.cc:299] Negotiation successful
0807 22:50:01.393651 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:50:01.395607 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:01.376443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34141 (local address 127.12.112.194:33171)
0807 22:50:01.377622 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:01.377692 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:01.378861 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:01.380816 (+ 1955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:01.380828 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:01.381195 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:01.381893 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:01.381914 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.383137 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.383140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:01.384538 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:01.384549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.385340 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.385345 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:01.385550 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:01.387422 (+ 1872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:01.387456 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:01.389172 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:01.391328 (+ 2156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:01.391336 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:01.391354 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:01.391718 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:01.392068 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:01.392074 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:01.392079 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:01.392267 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:01.392839 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:01.392848 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:01.393199 (+ 351us) client_negotiation.cc:769] Sending connection context
0807 22:50:01.394084 (+ 885us) client_negotiation.cc:240] Negotiation successful
0807 22:50:01.394440 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":947,"thread_start_us":141,"threads_started":1}
I20260807 22:50:01.397220 25939 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34141
I20260807 22:50:01.397467 25939 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:01.398099 25939 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:50:01.399296 25554 ts_manager.cc:194] Registered new tserver with Master: 936298ec636b408387fe0b6b55b6500c (127.12.112.194:35187)
I20260807 22:50:01.400079 25554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:33171
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:50:01.419392 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:46891/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34141
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:01.558027 25944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:01.558293 25944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:01.558431 25944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:01.562604 25944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:01.562711 25944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:01.562808 25944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:50:01.569280 25944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.112.212:46891/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:34141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:01.570443 25944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:01.571640 25944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:50:01.581997 25944 server_base.cc:1034] running on GCE node
W20260807 22:50:01.582554 25952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:01.582868 25950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:01.583036 25949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:01.583801 25944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:01.584442 25944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:01.585604 25944 hybrid_clock.cc:648] HybridClock initialized: now 1786143001585573 us; error 46 us; skew 500 ppm
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143001, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:01.588918 25944 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:50:01.590021 25944 webserver.cc:460] Webserver started at http://127.12.112.195:40129/ using document root <none> and password file <none>
I20260807 22:50:01.590693 25944 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:01.590790 25944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:01.591012 25944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143001, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:50:01.608135 25944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "eacc6ba4cfa640e3be9571be9d0cd45f"
format_stamp: "Formatted at 2026-08-07 22:50:01 on dist-test-slave-tm1g"
server_key: "3aa129b3479b6584ab61f42f7c7a9d3d"
server_key_iv: "9239a73b3bc04035fa6f12d50f02335a"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:01.608858 25944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "eacc6ba4cfa640e3be9571be9d0cd45f"
format_stamp: "Formatted at 2026-08-07 22:50:01 on dist-test-slave-tm1g"
server_key: "3aa129b3479b6584ab61f42f7c7a9d3d"
server_key_iv: "9239a73b3bc04035fa6f12d50f02335a"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:01.614059 25944 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260807 22:50:01.630609 25960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:01.632193 25944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:50:01.632323 25944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "eacc6ba4cfa640e3be9571be9d0cd45f"
format_stamp: "Formatted at 2026-08-07 22:50:01 on dist-test-slave-tm1g"
server_key: "3aa129b3479b6584ab61f42f7c7a9d3d"
server_key_iv: "9239a73b3bc04035fa6f12d50f02335a"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:01.632447 25944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:01.659588 25944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:01.663110 25944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:01.663300 25944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:01.663906 25944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:01.664938 25944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:01.664996 25944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:01.665047 25944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:01.665112 25944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:01.675360 25944 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:36067
I20260807 22:50:01.675526 26082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:36067 every 8 connection(s)
I20260807 22:50:01.676397 25944 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:50:01.679134 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 25944
I20260807 22:50:01.679265 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:50:01.679600 12739 external_mini_cluster.cc:1428] Setting key 108b03996db14fae814bde055650b717
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143001, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:01.697842 25793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:01.678561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:56827 (local address 127.12.112.254:34141)
0807 22:50:01.678699 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:01.678704 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:01.682210 (+ 3506us) server_negotiation.cc:407] Connection header received
0807 22:50:01.683658 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:01.683661 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:01.683721 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:01.683777 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:01.685469 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.686297 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.688036 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.688386 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.688479 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:01.691632 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:01.691636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:01.691639 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:01.691666 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:01.695113 (+ 3447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:01.695757 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:01.695760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:01.695763 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:01.695848 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:01.696269 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:01.696273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:01.696275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:01.696699 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:01.696783 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:01.697511 (+ 728us) server_negotiation.cc:299] Negotiation successful
0807 22:50:01.697642 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:50:01.700130 26085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:01.679057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34141 (local address 127.12.112.195:56827)
0807 22:50:01.682060 (+ 3003us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:01.682120 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:01.683398 (+ 1278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:01.684201 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:01.684213 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:01.684591 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:01.685285 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:01.685307 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.686498 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.686503 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:01.687887 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:01.687899 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:01.688685 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:01.688689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:01.688883 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:01.689608 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:01.689631 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:01.691424 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:01.695245 (+ 3821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:01.695251 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:01.695267 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:01.695636 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:01.695962 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:01.695964 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:01.695966 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:01.696147 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:01.696877 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:01.696884 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:01.697199 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 22:50:01.698542 (+ 1343us) client_negotiation.cc:240] Negotiation successful
0807 22:50:01.698882 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2776,"thread_start_us":185,"threads_started":1}
I20260807 22:50:01.701685 26083 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34141
I20260807 22:50:01.701913 26083 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:01.702524 26083 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
I20260807 22:50:01.703693 25554 ts_manager.cc:194] Registered new tserver with Master: eacc6ba4cfa640e3be9571be9d0cd45f (127.12.112.195:36067)
I20260807 22:50:01.704420 25554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:56827
I20260807 22:50:01.707629 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:50:01.708387 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 25642
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143001, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:50:01.715934 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 25795
I20260807 22:50:01.726048 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 25944
I20260807 22:50:01.734421 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 25519
I20260807 22:50:01.744626 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:34141
--webserver_interface=127.12.112.254
--webserver_port=33155
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:34141
--ranger_config_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:46891/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.112.212:46891/kms with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:01.864347 26086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:01.864588 26086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:01.864624 26086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:01.868695 26086 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:50:01.868745 26086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:01.868765 26086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:01.868781 26086 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:50:01.868836 26086 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:50:01.874059 26086 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.112.212:46891/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:34141
--ranger_config_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:34141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=33155
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:01.875038 26086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:01.875995 26086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:01.884384 26095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:01.884436 26086 server_base.cc:1034] running on GCE node
W20260807 22:50:01.884444 26091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:01.884621 26093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:01.885130 26086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:01.886155 26086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:01.887311 26086 hybrid_clock.cc:648] HybridClock initialized: now 1786143001887284 us; error 45 us; skew 500 ppm
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143001, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:01.889918 26086 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:50:01.890821 26086 webserver.cc:460] Webserver started at http://127.12.112.254:33155/ using document root <none> and password file <none>
I20260807 22:50:01.891343 26086 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:01.891435 26086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:50:01 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143001, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:50:01.944383 26086 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:50:01.946919 26103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:01.948436 26086 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:50:01.948587 26086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "cfc3f6e4aa594f8d9764818567b4028a"
format_stamp: "Formatted at 2026-08-07 22:49:59 on dist-test-slave-tm1g"
server_key: "6a9f29c90544b3d87bc09bb64125b36f"
server_key_iv: "fa20a43701caa33e37393725044b1a62"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:01.949160 26086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:01.965512 26086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:01.968119 26086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:01.968330 26086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:01.975508 26086 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:34141
I20260807 22:50:01.975539 26161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:34141 every 8 connection(s)
I20260807 22:50:01.976518 26086 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:50:01.978600 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 26086
I20260807 22:50:01.979056 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:46891/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:35671
--local_ip_for_outbound_sockets=127.12.112.193
--tserver_master_addrs=127.12.112.254:34141
--webserver_port=42693
--webserver_interface=127.12.112.193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.112.212:46891/kms with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:50:01.980728 26162 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:50:01.982285 26162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: Bootstrap starting.
I20260807 22:50:01.998307 26162 log.cc:824] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:02.004545 26162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:50:02.004925 26162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: Bootstrap complete.
I20260807 22:50:02.008991 26162 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } }
I20260807 22:50:02.009374 26162 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc3f6e4aa594f8d9764818567b4028a, State: Initialized, Role: FOLLOWER
I20260807 22:50:02.009920 26162 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } }
I20260807 22:50:02.010108 26162 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:50:02.010195 26162 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:50:02.010320 26162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:50:02.012648 26162 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } }
I20260807 22:50:02.012974 26162 leader_election.cc:302] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfc3f6e4aa594f8d9764818567b4028a; no voters:
I20260807 22:50:02.013293 26162 leader_election.cc:288] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:50:02.013377 26167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:50:02.013614 26167 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [term 2 LEADER]: Becoming Leader. State: Replica: cfc3f6e4aa594f8d9764818567b4028a, State: Running, Role: LEADER
I20260807 22:50:02.013947 26167 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } }
I20260807 22:50:02.014529 26162 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:50:02.015421 26169 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfc3f6e4aa594f8d9764818567b4028a. Latest consensus state: current_term: 2 leader_uuid: "cfc3f6e4aa594f8d9764818567b4028a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } } }
I20260807 22:50:02.015561 26169 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:02.015450 26168 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cfc3f6e4aa594f8d9764818567b4028a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfc3f6e4aa594f8d9764818567b4028a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34141 } } }
I20260807 22:50:02.015949 26168 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:02.016780 26171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:50:02.017279 26162 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 22:50:02.019505 26171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:50:02.020048 26171 catalog_manager.cc:1259] Loaded cluster ID: bdd1ef44364a4d41ae99726c70ef4309
I20260807 22:50:02.020120 26171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:50:02.021773 26171 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:50:02.022380 26171 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: Loaded TSK: 0
I20260807 22:50:02.025933 26171 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:50:02.119009 26165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:02.119426 26165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:02.119547 26165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:02.125512 26165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:02.125654 26165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:02.125793 26165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:50:02.133387 26165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.112.212:46891/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:35671
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=42693
--tserver_master_addrs=127.12.112.254:34141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:02.134909 26165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:02.136224 26165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:02.148012 26201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:02.148105 26200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:02.148028 26203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:02.149317 26165 server_base.cc:1034] running on GCE node
I20260807 22:50:02.149748 26165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:02.150496 26165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:02.151649 26165 hybrid_clock.cc:648] HybridClock initialized: now 1786143002151589 us; error 75 us; skew 500 ppm
Aug 07 22:50:02 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143002, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:02.155146 26165 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:50:02.156163 26165 webserver.cc:460] Webserver started at http://127.12.112.193:42693/ using document root <none> and password file <none>
I20260807 22:50:02.156822 26165 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:02.156944 26165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:50:02 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143002, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:50:02.180615 26165 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.002s sys 0.001s
I20260807 22:50:02.190285 26216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:02.192062 26165 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.001s sys 0.000s
I20260807 22:50:02.192278 26165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "31367bcac3794354a324c41b9777bf4e"
format_stamp: "Formatted at 2026-08-07 22:50:00 on dist-test-slave-tm1g"
server_key: "254ba28b76583783e23c066171b269e5"
server_key_iv: "3d87225142caff21b5d4261b3d879b5e"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:02.193117 26165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:02.225621 26165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:02.229537 26165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:02.229816 26165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:02.230628 26165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:02.231696 26165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:02.231808 26165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:02.231940 26165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:02.232020 26165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:02.242967 26165 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:35671
I20260807 22:50:02.243052 26336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:35671 every 8 connection(s)
I20260807 22:50:02.244390 26165 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:50:02.245872 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 26165
I20260807 22:50:02.246420 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:46891/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:35187
--local_ip_for_outbound_sockets=127.12.112.194
--tserver_master_addrs=127.12.112.254:34141
--webserver_port=36263
--webserver_interface=127.12.112.194
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.112.212:46891/kms with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:50:02 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143002, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:02.272554 26340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:02.246922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34141 (local address 127.12.112.193:37647)
0807 22:50:02.248494 (+ 1572us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:02.248547 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:02.249478 (+ 931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:02.250802 (+ 1324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:02.250810 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:02.251188 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:02.251853 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:02.251874 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.253816 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.253822 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:02.260035 (+ 6213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:02.260049 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.261352 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.261357 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:02.261549 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:02.262342 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:02.262368 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:02.265843 (+ 3475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:02.268592 (+ 2749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:02.268598 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:02.268614 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:02.268968 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:02.269420 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:02.269423 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:02.269425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:02.269601 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:02.270568 (+ 967us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:02.270575 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:02.270879 (+ 304us) client_negotiation.cc:769] Sending connection context
0807 22:50:02.271084 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 22:50:02.271436 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1368,"thread_start_us":148,"threads_started":1}
I20260807 22:50:02.274390 26339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:02.246854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:37647 (local address 127.12.112.254:34141)
0807 22:50:02.247778 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:02.247801 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:02.249721 (+ 1920us) server_negotiation.cc:407] Connection header received
0807 22:50:02.249995 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:02.250008 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:02.250414 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:02.250736 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:02.252063 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.253658 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.260214 (+ 6556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.260954 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.261118 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:02.266111 (+ 4993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:02.266118 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:02.266138 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:02.266172 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:02.268448 (+ 2276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:02.269133 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:02.269140 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:02.269145 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:02.269296 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:02.269734 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:02.269738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:02.269740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:02.270250 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:02.270506 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:02.273146 (+ 2640us) server_negotiation.cc:299] Negotiation successful
0807 22:50:02.273429 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":119,"threads_started":1}
I20260807 22:50:02.277923 26337 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34141
I20260807 22:50:02.278172 26337 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:02.278782 26337 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
W20260807 22:50:02.281153 26337 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:34141 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 22:50:02.281279 26337 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:02.281452 26337 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
I20260807 22:50:02.282440 26337 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:02.282629 26337 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
W20260807 22:50:02.283605 26337 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:50:02.390645 26341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:02.391006 26341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:02.391072 26341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:02.396042 26341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:02.396124 26341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:02.396214 26341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:50:02.401989 26341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.112.212:46891/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:35187
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=36263
--tserver_master_addrs=127.12.112.254:34141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:02.403095 26341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:02.404335 26341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:02.416107 26349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:02.416996 26346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:02.416107 26347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:02.418578 26341 server_base.cc:1034] running on GCE node
I20260807 22:50:02.419198 26341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:02.419984 26341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:02.421177 26341 hybrid_clock.cc:648] HybridClock initialized: now 1786143002421148 us; error 37 us; skew 500 ppm
Aug 07 22:50:02 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143002, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:02.424492 26341 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:50:02.425595 26341 webserver.cc:460] Webserver started at http://127.12.112.194:36263/ using document root <none> and password file <none>
I20260807 22:50:02.426272 26341 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:02.426395 26341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:50:02 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143002, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:50:02.455859 26341 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:50:02.459015 26358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:02.460409 26341 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:50:02.460553 26341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "936298ec636b408387fe0b6b55b6500c"
format_stamp: "Formatted at 2026-08-07 22:50:01 on dist-test-slave-tm1g"
server_key: "2ce11b92a2ef60fbf0666cd7e119e5c3"
server_key_iv: "86fa73b6b052ff6b57345700be836fd9"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:02.461136 26341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:02.496340 26341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:02.500047 26341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:02.500329 26341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:02.501156 26341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:02.502341 26341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:02.502455 26341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:02.502559 26341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:02.502635 26341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:02.516482 26341 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:35187
I20260807 22:50:02.518118 26341 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:50:02.518172 26486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:35187 every 8 connection(s)
I20260807 22:50:02.519431 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 26341
I20260807 22:50:02.519903 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.112.212:46891/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:36067
--local_ip_for_outbound_sockets=127.12.112.195
--tserver_master_addrs=127.12.112.254:34141
--webserver_port=40129
--webserver_interface=127.12.112.195
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.112.212:46891/kms with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:50:02 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143002, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:02.537364 26339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:02.520762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:54523 (local address 127.12.112.254:34141)
0807 22:50:02.520936 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:02.520943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:02.522871 (+ 1928us) server_negotiation.cc:407] Connection header received
0807 22:50:02.524118 (+ 1247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:02.524122 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:02.524183 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:02.524290 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:02.525711 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.526620 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.528586 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.529046 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.529147 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:02.532642 (+ 3495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:02.532646 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:02.532650 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:02.532689 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:02.534636 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:02.535360 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:02.535366 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:02.535369 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:02.535466 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:02.535947 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:02.535953 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:02.535957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:02.536250 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:02.536336 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:02.537047 (+ 711us) server_negotiation.cc:299] Negotiation successful
0807 22:50:02.537183 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:50:02.539243 26490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:02.521304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34141 (local address 127.12.112.194:54523)
0807 22:50:02.522688 (+ 1384us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:02.522746 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:02.523871 (+ 1125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:02.524482 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:02.524491 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:02.524854 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:02.525524 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:02.525541 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.526791 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.526797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:02.528416 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:02.528431 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.529395 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.529402 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:02.529642 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:02.530450 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:02.530477 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:02.532412 (+ 1935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:02.534785 (+ 2373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:02.534794 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:02.534815 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:02.535222 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:02.535598 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:02.535602 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:02.535607 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:02.535816 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:02.536433 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:02.536443 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:02.536759 (+ 316us) client_negotiation.cc:769] Sending connection context
0807 22:50:02.537836 (+ 1077us) client_negotiation.cc:240] Negotiation successful
0807 22:50:02.538184 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1159,"thread_start_us":148,"threads_started":1}
I20260807 22:50:02.540740 26487 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34141
I20260807 22:50:02.541039 26487 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:02.541625 26487 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
W20260807 22:50:02.543247 26487 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:34141 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 22:50:02.543418 26487 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:02.543629 26487 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
I20260807 22:50:02.544481 26487 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:02.544713 26487 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
W20260807 22:50:02.545456 26487 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:50:02.660157 26489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:02.660598 26489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:02.660717 26489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:02.666567 26489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:02.666689 26489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:02.666801 26489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:50:02.673107 26489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.112.212:46891/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:36067
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=40129
--tserver_master_addrs=127.12.112.254:34141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:02.674407 26489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:02.675587 26489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:02.686550 26495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:02.686556 26498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:02.687655 26489 server_base.cc:1034] running on GCE node
W20260807 22:50:02.690490 26496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:02.691018 26489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:02.691778 26489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:02.692986 26489 hybrid_clock.cc:648] HybridClock initialized: now 1786143002692930 us; error 71 us; skew 500 ppm
Aug 07 22:50:02 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143002, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:02.696254 26489 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:50:02.697127 26489 webserver.cc:460] Webserver started at http://127.12.112.195:40129/ using document root <none> and password file <none>
I20260807 22:50:02.697703 26489 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:02.697815 26489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:50:02 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143002, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:50:02.716837 26489 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:50:02.720513 26506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:02.721998 26489 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:50:02.722137 26489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "eacc6ba4cfa640e3be9571be9d0cd45f"
format_stamp: "Formatted at 2026-08-07 22:50:01 on dist-test-slave-tm1g"
server_key: "3aa129b3479b6584ab61f42f7c7a9d3d"
server_key_iv: "9239a73b3bc04035fa6f12d50f02335a"
server_key_version: "kuduclusterkey@0"
I20260807 22:50:02.723024 26489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:02.742632 26489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:02.746490 26489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:02.746757 26489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:02.747601 26489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:02.748518 26489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:02.748588 26489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:02.748656 26489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:02.748703 26489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:02.760015 26489 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:36067
I20260807 22:50:02.760092 26627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:36067 every 8 connection(s)
I20260807 22:50:02.761176 26489 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:50:02.761574 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 26489
Aug 07 22:50:02 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143002, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:02.779932 26633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:02.765782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:33923 (local address 127.12.112.254:34141)
0807 22:50:02.766035 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:02.766041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:02.766056 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:50:02.766816 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:02.766819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:02.766867 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:02.766946 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:02.769610 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.770441 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.772118 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.772483 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.772601 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:02.776101 (+ 3500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:02.776104 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:02.776107 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:02.776133 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:02.777597 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:02.778114 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:02.778118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:02.778120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:02.778203 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:02.778595 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:02.778599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:02.778601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:02.778844 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:02.778932 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:02.779575 (+ 643us) server_negotiation.cc:299] Negotiation successful
0807 22:50:02.779730 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":88,"threads_started":1}
I20260807 22:50:02.779940 26339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:02.762572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34796 (local address 127.12.112.254:34141)
0807 22:50:02.762710 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:02.762714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:02.763943 (+ 1229us) server_negotiation.cc:407] Connection header received
0807 22:50:02.764083 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:02.764086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:02.764147 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:02.764262 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:02.766500 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.767298 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.768743 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.769101 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.769212 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:02.772532 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:02.772535 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:02.772537 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:02.772592 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:02.774450 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:02.778761 (+ 4311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:02.778764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:02.778766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:02.778835 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:02.779162 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:02.779165 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:02.779167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:02.779356 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:02.779552 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:02.779740 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 22:50:02.779829 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:50:02.781797 26632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:02.764653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:34141 (local address 127.12.112.195:33923)
0807 22:50:02.765425 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:02.765488 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:02.766506 (+ 1018us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:02.767211 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:02.767220 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:02.768771 (+ 1551us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:02.769441 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:02.769462 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.770598 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.770601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:02.771978 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:02.771990 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:02.772667 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:02.772671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:02.773046 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:02.773676 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:02.774557 (+ 881us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:02.775927 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:02.777721 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:02.777727 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:02.777742 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:02.778008 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:02.778326 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:02.778332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:02.778336 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:02.778494 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:02.778990 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:02.778995 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:02.779294 (+ 299us) client_negotiation.cc:769] Sending connection context
0807 22:50:02.780095 (+ 801us) client_negotiation.cc:240] Negotiation successful
0807 22:50:02.780454 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":151,"threads_started":1}
I20260807 22:50:02.783037 26628 heartbeater.cc:347] Connected to a master server at 127.12.112.254:34141
I20260807 22:50:02.783288 26628 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:02.783785 26628 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
I20260807 22:50:02.785063 26121 ts_manager.cc:194] Registered new tserver with Master: eacc6ba4cfa640e3be9571be9d0cd45f (127.12.112.195:36067)
I20260807 22:50:02.786198 26121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:33923
Aug 07 22:50:03 dist-test-slave-tm1g krb5kdc[25035](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786143003, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:03.283849 26337 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:03.284166 26337 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
I20260807 22:50:03.285020 26121 ts_manager.cc:194] Registered new tserver with Master: 31367bcac3794354a324c41b9777bf4e (127.12.112.193:35671)
I20260807 22:50:03.285843 26121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:37647
Aug 07 22:50:03 dist-test-slave-tm1g krb5kdc[25035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143003, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for HTTP/127.12.112.212@KRBTEST.COM
I20260807 22:50:03.545718 26487 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:03.546005 26487 heartbeater.cc:511] Master 127.12.112.254:34141 requested a full tablet report, sending...
I20260807 22:50:03.546721 26121 ts_manager.cc:194] Registered new tserver with Master: 936298ec636b408387fe0b6b55b6500c (127.12.112.194:35187)
I20260807 22:50:03.547482 26121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:54523
I20260807 22:50:03.554133 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:50:03.570358 26650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.555810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34800 (local address 127.12.112.254:34141)
0807 22:50:03.556048 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:03.556053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:03.556271 (+ 218us) server_negotiation.cc:407] Connection header received
0807 22:50:03.556367 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:03.556370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:03.556421 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:03.556533 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:03.557372 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.558206 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.559406 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.559772 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.559898 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.566258 (+ 6360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:03.566262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:03.566265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:03.566295 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:03.568290 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:03.568768 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:03.568772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:03.568774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:03.568870 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:03.569182 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:03.569185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:03.569187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:03.569427 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:03.569591 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:03.569851 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 22:50:03.570112 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":73,"threads_started":1}
I20260807 22:50:03.574584 26121 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34800:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:50:03.579375 26121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:50:03.597227 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.590406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50266 (local address 127.12.112.194:35187)
0807 22:50:03.591003 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:03.591010 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:03.591403 (+ 393us) server_negotiation.cc:407] Connection header received
0807 22:50:03.591678 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:03.591683 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:03.591886 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:03.592001 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:03.592542 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.593746 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.595472 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.596302 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.596409 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.596536 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:03.596968 (+ 432us) server_negotiation.cc:299] Negotiation successful
0807 22:50:03.597075 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":69,"threads_started":1}
I20260807 22:50:03.597920 26658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.590204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:35187 (local address 127.0.0.1:50266)
0807 22:50:03.591255 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:03.591316 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:03.591510 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:03.592203 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:03.592208 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:03.592231 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:03.592401 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:03.592409 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.593892 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.593895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:03.595325 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:03.595337 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.596636 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.596639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:03.596763 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.596799 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 22:50:03.597650 (+ 851us) client_negotiation.cc:240] Negotiation successful
0807 22:50:03.597781 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":890,"thread_start_us":125,"threads_started":1}
I20260807 22:50:03.601380 26391 tablet_service.cc:1467] Processing CreateTablet for tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0 (DEFAULT_TABLE table=test-table [id=a6a0400eb06b4cb189d7ed576de1fa87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:03.601886 26656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.590834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:35671 (local address 127.0.0.1:60114)
0807 22:50:03.594501 (+ 3667us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:03.594517 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:03.594610 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:03.596892 (+ 2282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:03.596895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:03.596913 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:03.597004 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:03.597009 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.599236 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.599239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:03.600402 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:03.600413 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.601495 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.601500 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:03.601594 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.601619 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:50:03.601675 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:50:03.601740 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3604,"thread_start_us":101,"threads_started":1}
I20260807 22:50:03.602545 26391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:03.603180 26659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.590996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60114 (local address 127.12.112.193:35671)
0807 22:50:03.595853 (+ 4857us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:03.595860 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:03.595884 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:50:03.595961 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:03.595966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:03.596151 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:03.597154 (+ 1003us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:03.597289 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.599110 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.600570 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.601330 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.602790 (+ 1460us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.602911 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:03.602960 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 22:50:03.603046 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4750,"thread_start_us":97,"threads_started":1}
I20260807 22:50:03.606058 26261 tablet_service.cc:1467] Processing CreateTablet for tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0 (DEFAULT_TABLE table=test-table [id=a6a0400eb06b4cb189d7ed576de1fa87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:03.607168 26261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:03.612205 26660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.591184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:36067 (local address 127.0.0.1:58138)
0807 22:50:03.595508 (+ 4324us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:03.595524 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:03.595614 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:03.598420 (+ 2806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:03.598423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:03.598441 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:03.598536 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:03.598545 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.602118 (+ 3573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.602123 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:03.603234 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:03.603247 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.611772 (+ 8525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.611776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:03.611871 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.611896 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:50:03.611982 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:50:03.612059 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4256,"thread_start_us":109,"threads_started":1}
I20260807 22:50:03.612659 26662 tablet_bootstrap.cc:492] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: Bootstrap starting.
I20260807 22:50:03.612725 26661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.591462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58138 (local address 127.12.112.195:36067)
0807 22:50:03.596457 (+ 4995us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:03.596464 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:03.596486 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:50:03.596559 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:03.596563 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:03.596732 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:03.599221 (+ 2489us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:03.599369 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.600539 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.610539 (+ 10000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.611453 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.611581 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.611704 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:03.612466 (+ 762us) server_negotiation.cc:299] Negotiation successful
0807 22:50:03.612571 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4866,"thread_start_us":97,"threads_started":1}
I20260807 22:50:03.615325 26662 tablet_bootstrap.cc:654] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:03.615804 26556 tablet_service.cc:1467] Processing CreateTablet for tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0 (DEFAULT_TABLE table=test-table [id=a6a0400eb06b4cb189d7ed576de1fa87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:03.616331 26662 log.cc:824] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:03.616804 26556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:03.618804 26662 tablet_bootstrap.cc:492] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: No bootstrap required, opened a new log
I20260807 22:50:03.619001 26662 ts_tablet_manager.cc:1397] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:50:03.622784 26662 raft_consensus.cc:348] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 } } peers { permanent_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36067 } } peers { permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 } }
I20260807 22:50:03.623052 26662 raft_consensus.cc:374] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:03.623106 26662 raft_consensus.cc:729] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936298ec636b408387fe0b6b55b6500c, State: Initialized, Role: FOLLOWER
I20260807 22:50:03.623587 26662 consensus_queue.cc:260] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 } } peers { permanent_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36067 } } peers { permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 } }
I20260807 22:50:03.624586 26662 ts_tablet_manager.cc:1428] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:50:03.624925 26487 heartbeater.cc:503] Master 127.12.112.254:34141 was elected leader, sending a full tablet report...
I20260807 22:50:03.630362 26665 tablet_bootstrap.cc:492] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f: Bootstrap starting.
I20260807 22:50:03.632732 26665 tablet_bootstrap.cc:654] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:03.633380 26666 tablet_bootstrap.cc:492] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e: Bootstrap starting.
I20260807 22:50:03.633714 26665 log.cc:824] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:03.635519 26666 tablet_bootstrap.cc:654] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:03.635891 26665 tablet_bootstrap.cc:492] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f: No bootstrap required, opened a new log
I20260807 22:50:03.636087 26665 ts_tablet_manager.cc:1397] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:50:03.636332 26666 log.cc:824] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:03.638888 26666 tablet_bootstrap.cc:492] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e: No bootstrap required, opened a new log
I20260807 22:50:03.639065 26666 ts_tablet_manager.cc:1397] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260807 22:50:03.640652 26665 raft_consensus.cc:348] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 } } peers { permanent_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36067 } } peers { permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 } }
I20260807 22:50:03.640971 26665 raft_consensus.cc:374] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:03.641067 26665 raft_consensus.cc:729] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc6ba4cfa640e3be9571be9d0cd45f, State: Initialized, Role: FOLLOWER
I20260807 22:50:03.641568 26665 consensus_queue.cc:260] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 } } peers { permanent_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36067 } } peers { permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 } }
I20260807 22:50:03.642668 26665 ts_tablet_manager.cc:1428] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 22:50:03.643054 26628 heartbeater.cc:503] Master 127.12.112.254:34141 was elected leader, sending a full tablet report...
I20260807 22:50:03.643925 26666 raft_consensus.cc:348] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 } } peers { permanent_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36067 } } peers { permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 } }
I20260807 22:50:03.644169 26666 raft_consensus.cc:374] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:03.644219 26666 raft_consensus.cc:729] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31367bcac3794354a324c41b9777bf4e, State: Initialized, Role: FOLLOWER
I20260807 22:50:03.644692 26666 consensus_queue.cc:260] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 } } peers { permanent_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36067 } } peers { permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 } }
I20260807 22:50:03.645653 26666 ts_tablet_manager.cc:1428] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:50:03.645996 26337 heartbeater.cc:503] Master 127.12.112.254:34141 was elected leader, sending a full tablet report...
I20260807 22:50:03.648708 26669 raft_consensus.cc:482] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:50:03.648909 26669 raft_consensus.cc:504] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 } } peers { permanent_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36067 } } peers { permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 } }
I20260807 22:50:03.649932 26669 leader_election.cc:288] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936298ec636b408387fe0b6b55b6500c (127.12.112.194:35187), 31367bcac3794354a324c41b9777bf4e (127.12.112.193:35671)
I20260807 22:50:03.654883 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.650520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:47951 (local address 127.12.112.194:35187)
0807 22:50:03.650644 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:03.650648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:03.650659 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:50:03.650713 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:03.650715 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:03.650751 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:03.650838 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:03.651185 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.651970 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.653491 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.654117 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.654200 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.654253 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:03.654680 (+ 427us) server_negotiation.cc:299] Negotiation successful
0807 22:50:03.654755 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:50:03.655506 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.650098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:35187 (local address 127.12.112.195:47951)
0807 22:50:03.650396 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:03.650415 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:03.650523 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:03.650849 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:03.650852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:03.650883 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:03.651034 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:03.651045 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.652102 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.652105 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:03.653344 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:03.653354 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.654404 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.654407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:03.654538 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.654561 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:50:03.655170 (+ 609us) client_negotiation.cc:240] Negotiation successful
0807 22:50:03.655242 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":22,"thread_start_us":133,"threads_started":1}
I20260807 22:50:03.656652 26434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16ce1d0e05c4a4f94ed396fdbfb9fa0" candidate_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936298ec636b408387fe0b6b55b6500c" is_pre_election: true
I20260807 22:50:03.656751 26659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.651467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:55921 (local address 127.12.112.193:35671)
0807 22:50:03.651565 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:03.651569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:03.651760 (+ 191us) server_negotiation.cc:407] Connection header received
0807 22:50:03.651970 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:03.651975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:03.652024 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:03.652071 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:03.653124 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.653865 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.655410 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.655967 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.656051 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.656082 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:03.656565 (+ 483us) server_negotiation.cc:299] Negotiation successful
0807 22:50:03.656644 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 22:50:03.656956 26434 raft_consensus.cc:2454] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc6ba4cfa640e3be9571be9d0cd45f in term 0.
I20260807 22:50:03.657146 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.651143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:35671 (local address 127.12.112.195:55921)
0807 22:50:03.651686 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:03.651698 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:03.651813 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:03.652218 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:03.652221 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:03.652236 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:03.652907 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:03.652914 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.654059 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.654063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:03.655272 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:03.655281 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.656303 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.656306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:03.656415 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.656442 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:50:03.656910 (+ 468us) client_negotiation.cc:240] Negotiation successful
0807 22:50:03.657004 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":86,"threads_started":1}
I20260807 22:50:03.657670 26285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16ce1d0e05c4a4f94ed396fdbfb9fa0" candidate_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31367bcac3794354a324c41b9777bf4e" is_pre_election: true
I20260807 22:50:03.657733 26510 leader_election.cc:302] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936298ec636b408387fe0b6b55b6500c, eacc6ba4cfa640e3be9571be9d0cd45f; no voters:
I20260807 22:50:03.657922 26285 raft_consensus.cc:2454] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc6ba4cfa640e3be9571be9d0cd45f in term 0.
I20260807 22:50:03.658005 26669 raft_consensus.cc:2781] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:50:03.658071 26669 raft_consensus.cc:482] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:50:03.658114 26669 raft_consensus.cc:3037] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:03.659412 26669 raft_consensus.cc:504] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 } } peers { permanent_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36067 } } peers { permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 } }
I20260807 22:50:03.659804 26669 leader_election.cc:288] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [CANDIDATE]: Term 1 election: Requested vote from peers 936298ec636b408387fe0b6b55b6500c (127.12.112.194:35187), 31367bcac3794354a324c41b9777bf4e (127.12.112.193:35671)
I20260807 22:50:03.660127 26434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16ce1d0e05c4a4f94ed396fdbfb9fa0" candidate_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936298ec636b408387fe0b6b55b6500c"
I20260807 22:50:03.660257 26434 raft_consensus.cc:3037] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:03.660408 26285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16ce1d0e05c4a4f94ed396fdbfb9fa0" candidate_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31367bcac3794354a324c41b9777bf4e"
I20260807 22:50:03.660514 26285 raft_consensus.cc:3037] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:03.661583 26434 raft_consensus.cc:2454] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc6ba4cfa640e3be9571be9d0cd45f in term 1.
I20260807 22:50:03.661741 26285 raft_consensus.cc:2454] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc6ba4cfa640e3be9571be9d0cd45f in term 1.
I20260807 22:50:03.662052 26507 leader_election.cc:302] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31367bcac3794354a324c41b9777bf4e, eacc6ba4cfa640e3be9571be9d0cd45f; no voters:
I20260807 22:50:03.662279 26669 raft_consensus.cc:2781] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:50:03.662547 26669 raft_consensus.cc:686] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 1 LEADER]: Becoming Leader. State: Replica: eacc6ba4cfa640e3be9571be9d0cd45f, State: Running, Role: LEADER
I20260807 22:50:03.662892 26669 consensus_queue.cc:237] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 } } peers { permanent_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36067 } } peers { permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 } }
I20260807 22:50:03.666208 26120 catalog_manager.cc:5495] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc6ba4cfa640e3be9571be9d0cd45f (127.12.112.195). New cstate: current_term: 1 leader_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc6ba4cfa640e3be9571be9d0cd45f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 } health_report { overall_health: UNKNOWN } } }
I20260807 22:50:03.696357 26661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.692312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58148 (local address 127.12.112.195:36067)
0807 22:50:03.692434 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:03.692439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:03.692540 (+ 101us) server_negotiation.cc:407] Connection header received
0807 22:50:03.692744 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:03.692747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:03.692807 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:03.692919 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:50:03.693198 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.693720 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.694785 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:03.695015 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:03.695127 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:03.695451 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:50:03.695952 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:50:03.696081 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:03.696141 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 22:50:03.696203 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:50:03.702548 26285 raft_consensus.cc:1261] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 31367bcac3794354a324c41b9777bf4e [term 1 FOLLOWER]: Refusing update from remote peer eacc6ba4cfa640e3be9571be9d0cd45f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:03.702548 26434 raft_consensus.cc:1261] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c [term 1 FOLLOWER]: Refusing update from remote peer eacc6ba4cfa640e3be9571be9d0cd45f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:03.703310 26673 consensus_queue.cc:1035] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [LEADER]: Connected to new peer: Peer: permanent_uuid: "936298ec636b408387fe0b6b55b6500c" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:03.703471 26669 consensus_queue.cc:1035] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31367bcac3794354a324c41b9777bf4e" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:03.714232 26676 mvcc.cc:205] Tried to move back new op lower bound from 7316041743158484992 to 7316041743006150656. Current Snapshot: MvccSnapshot[applied={T|T < 7316041743158484992}]
I20260807 22:50:03.717809 26678 mvcc.cc:205] Tried to move back new op lower bound from 7316041743158484992 to 7316041743006150656. Current Snapshot: MvccSnapshot[applied={T|T < 7316041743158484992}]
I20260807 22:50:03.718860 26679 mvcc.cc:205] Tried to move back new op lower bound from 7316041743158484992 to 7316041743006150656. Current Snapshot: MvccSnapshot[applied={T|T < 7316041743158484992}]
I20260807 22:50:03.727696 26120 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:50:03.727903 26120 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:50:03.730576 26120 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfc3f6e4aa594f8d9764818567b4028a: Sending DeleteTablet for 3 replicas of tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0
I20260807 22:50:03.731297 26391 tablet_service.cc:1514] Processing DeleteTablet for tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:03 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:50266
I20260807 22:50:03.731781 26556 tablet_service.cc:1514] Processing DeleteTablet for tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:03 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:58138
I20260807 22:50:03.731961 26261 tablet_service.cc:1514] Processing DeleteTablet for tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:03 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:60114
I20260807 22:50:03.733192 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 26165
I20260807 22:50:03.740216 26686 tablet_replica.cc:330] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: stopping tablet replica
I20260807 22:50:03.740690 26686 raft_consensus.cc:2229] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:50:03.741202 26686 raft_consensus.cc:2258] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:03.743767 26686 ts_tablet_manager.cc:1905] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:03.745827 26687 tablet_replica.cc:330] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f: stopping tablet replica
I20260807 22:50:03.746198 26687 raft_consensus.cc:2229] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:50:03.746745 26687 raft_consensus.cc:2258] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:03.747249 26686 ts_tablet_manager.cc:1918] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:03.747445 26686 log.cc:1196] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/d16ce1d0e05c4a4f94ed396fdbfb9fa0
I20260807 22:50:03.747797 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 26341
I20260807 22:50:03.747897 26686 ts_tablet_manager.cc:1939] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P 936298ec636b408387fe0b6b55b6500c: Deleting consensus metadata
W20260807 22:50:03.748090 26105 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:35671 (error 108)
I20260807 22:50:03.749763 26687 ts_tablet_manager.cc:1905] T d16ce1d0e05c4a4f94ed396fdbfb9fa0 P eacc6ba4cfa640e3be9571be9d0cd45f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:03.758268 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 26489
I20260807 22:50:03.762751 26660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.762404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:35671 (local address 127.0.0.1:60118)
0807 22:50:03.762592 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:03.762659 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:35671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
W20260807 22:50:03.763020 26105 catalog_manager.cc:4584] TS 31367bcac3794354a324c41b9777bf4e (127.12.112.193:35671): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d16ce1d0e05c4a4f94ed396fdbfb9fa0: Network error: Client connection negotiation failed: client connection to 127.12.112.193:35671: connect: Connection refused (error 111)
I20260807 22:50:03.763779 26660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:03.763559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:35187 (local address 127.0.0.1:50272)
0807 22:50:03.763683 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:03.763723 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.194:35187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 22:50:03.768080 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 26086
I20260807 22:50:03.774821 12739 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 22:50:04.119477 12739 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 22:50:04.119585 12739 mini_ranger.cc:66] Stopping Ranger...
I20260807 22:50:04.463960 12739 mini_ranger.cc:68] Stopped Ranger
2026-08-07 22:50:04.464 UTC [25066] LOG: received smart shutdown request
2026-08-07 22:50:04.467 UTC [25066] LOG: background worker "logical replication launcher" (PID 25076) exited with exit code 1
2026-08-07 22:50:04.467 UTC [25071] LOG: shutting down
2026-08-07 22:50:04.619 UTC [25066] LOG: database system is shut down
2026-08-07T22:50:04Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48334 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:50:04 dist-test-slave-tm1g krb5kdc[26698](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:50:04 dist-test-slave-tm1g krb5kdc[26698](info): set up 2 sockets
Aug 07 22:50:04 dist-test-slave-tm1g krb5kdc[26698](info): commencing operation
krb5kdc: starting...
W20260807 22:50:05.818372 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:50:05 dist-test-slave-tm1g krb5kdc[26698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:50:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:50:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:50:05.939909 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:39137
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:42643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:39137,127.12.112.253:40517,127.12.112.252:45167
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:06.050251 26713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:06.050622 26713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:06.050669 26713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:06.055114 26713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:50:06.055186 26713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:06.055205 26713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:06.055224 26713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:50:06.055240 26713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:50:06.060871 26713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:42643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:39137,127.12.112.253:40517,127.12.112.252:45167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:39137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:06.062036 26713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:06.063154 26713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:06.071920 26718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:06.071928 26719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:06.071920 26721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:06.072355 26713 server_base.cc:1034] running on GCE node
I20260807 22:50:06.072881 26713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:06.073961 26713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:06.075146 26713 hybrid_clock.cc:648] HybridClock initialized: now 1786143006075122 us; error 47 us; skew 500 ppm
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:06.077914 26713 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:50:06.078883 26713 webserver.cc:460] Webserver started at http://127.12.112.254:36489/ using document root <none> and password file <none>
I20260807 22:50:06.079463 26713 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:06.079555 26713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:06.079787 26713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:06.081830 26713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "1ce6182834e14f63a844341c96c48e10"
format_stamp: "Formatted at 2026-08-07 22:50:06 on dist-test-slave-tm1g"
server_key: "c27201d33c17cc02725e91d642498c48"
server_key_iv: "b8e85ec3a17f9a72396bce9d6f665892"
server_key_version: "encryptionkey@0"
I20260807 22:50:06.082479 26713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "1ce6182834e14f63a844341c96c48e10"
format_stamp: "Formatted at 2026-08-07 22:50:06 on dist-test-slave-tm1g"
server_key: "c27201d33c17cc02725e91d642498c48"
server_key_iv: "b8e85ec3a17f9a72396bce9d6f665892"
server_key_version: "encryptionkey@0"
I20260807 22:50:06.086166 26713 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:50:06.088589 26728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:06.089757 26713 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:06.089895 26713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "1ce6182834e14f63a844341c96c48e10"
format_stamp: "Formatted at 2026-08-07 22:50:06 on dist-test-slave-tm1g"
server_key: "c27201d33c17cc02725e91d642498c48"
server_key_iv: "b8e85ec3a17f9a72396bce9d6f665892"
server_key_version: "encryptionkey@0"
I20260807 22:50:06.090011 26713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:06.106876 26713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:06.110196 26713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:06.110430 26713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:06.117568 26713 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:39137
I20260807 22:50:06.117865 26783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:39137 every 8 connection(s)
I20260807 22:50:06.118562 26713 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:50:06.121263 26784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:06.124877 26784 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:50:06.126220 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 26713
I20260807 22:50:06.126432 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:50:06.126747 12739 external_mini_cluster.cc:1428] Setting key e8582bf9163de6285874bbfc6863a662
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.253@KRBTEST.COM" created.
I20260807 22:50:06.140836 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.127344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39137 (local address 127.0.0.1:54262)
0807 22:50:06.127924 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.127982 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:06.128979 (+ 997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:06.129773 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:06.129777 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:06.130081 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:06.130402 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.130416 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.132261 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.132263 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.132965 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.132975 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.133908 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.133911 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.134010 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.134682 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:06.134698 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:06.136154 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:06.137889 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.137896 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.137903 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.138127 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.138607 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.138609 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.138611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.138758 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.139341 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:06.139350 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:06.139532 (+ 182us) client_negotiation.cc:769] Sending connection context
0807 22:50:06.139721 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 22:50:06.140078 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":50,"spinlock_wait_cycles":1280,"thread_start_us":154,"threads_started":1}
I20260807 22:50:06.140842 26788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.127344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54262 (local address 127.12.112.254:39137)
0807 22:50:06.127953 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.127970 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.128099 (+ 129us) server_negotiation.cc:407] Connection header received
0807 22:50:06.129297 (+ 1198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.129306 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.129555 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.129772 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.130573 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.132125 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.133100 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.133759 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.133957 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.136306 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.136311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.136320 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.136341 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.137784 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.138328 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.138335 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.138337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.138493 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.138863 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.138866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.138867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.139218 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.139323 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.139783 (+ 460us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.139996 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":491,"spinlock_wait_cycles":31104,"thread_start_us":189,"threads_started":1}
I20260807 22:50:06.143153 26784 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:50:06.143870 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.143633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:40517 (local address 127.0.0.1:50688)
0807 22:50:06.143743 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.143819 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:40517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 22:50:06.144057 26732 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.112.253:40517: connect: Connection refused (error 111)
I20260807 22:50:06.144835 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.144637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:40517 (local address 127.0.0.1:50698)
0807 22:50:06.144739 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.144781 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:40517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 22:50:06.144989 26784 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.253:40517: Network error: Client connection negotiation failed: client connection to 127.12.112.253:40517: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab.
Entry for principal kudu/127.12.112.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab.
I20260807 22:50:06.153327 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.253:40517
--webserver_interface=127.12.112.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab
--principal=kudu/127.12.112.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:42643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:39137,127.12.112.253:40517,127.12.112.252:45167
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:50:06.194231 26784 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } attempt: 1
I20260807 22:50:06.195254 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.194858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:40517 (local address 127.0.0.1:50708)
0807 22:50:06.195060 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.195153 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:40517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 22:50:06.196022 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.195785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:40517 (local address 127.0.0.1:50710)
0807 22:50:06.195900 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.195952 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:40517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 22:50:06.196157 26784 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.253:40517: Network error: Client connection negotiation failed: client connection to 127.12.112.253:40517: connect: Connection refused (error 111)
W20260807 22:50:06.262362 26792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:06.262646 26792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:06.262707 26792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 22:50:06.264425 26784 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } attempt: 2
I20260807 22:50:06.265285 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.264937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:40517 (local address 127.0.0.1:50718)
0807 22:50:06.265115 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.265185 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:40517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 22:50:06.266000 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.265785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:40517 (local address 127.0.0.1:50720)
0807 22:50:06.265889 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.265940 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:40517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 22:50:06.266134 26784 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.253:40517: Network error: Client connection negotiation failed: client connection to 127.12.112.253:40517: connect: Connection refused (error 111)
W20260807 22:50:06.267179 26792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:50:06.267246 26792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:06.267292 26792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:06.267328 26792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:50:06.267364 26792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:50:06.272423 26792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:42643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:39137,127.12.112.253:40517,127.12.112.252:45167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab
--principal=kudu/127.12.112.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.253:40517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.112.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:06.273396 26792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:06.274402 26792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:06.282680 26797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:06.282652 26798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:06.282794 26792 server_base.cc:1034] running on GCE node
W20260807 22:50:06.282963 26800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:06.283481 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:06.284471 26792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:06.285652 26792 hybrid_clock.cc:648] HybridClock initialized: now 1786143006285634 us; error 31 us; skew 500 ppm
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:06.288388 26792 init.cc:377] Logged in from keytab as kudu/127.12.112.253@KRBTEST.COM (short username kudu)
I20260807 22:50:06.289189 26792 webserver.cc:460] Webserver started at http://127.12.112.253:39003/ using document root <none> and password file <none>
I20260807 22:50:06.289719 26792 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:06.289808 26792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:06.290030 26792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:06.292025 26792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/data/instance:
uuid: "a0bd975fe41345b6a345461665d561c9"
format_stamp: "Formatted at 2026-08-07 22:50:06 on dist-test-slave-tm1g"
server_key: "f92ea66430d4e6989115a4fdc6f1c532"
server_key_iv: "7a97eecc72e7e434dcc58085979cee00"
server_key_version: "encryptionkey@0"
I20260807 22:50:06.292601 26792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/wal/instance:
uuid: "a0bd975fe41345b6a345461665d561c9"
format_stamp: "Formatted at 2026-08-07 22:50:06 on dist-test-slave-tm1g"
server_key: "f92ea66430d4e6989115a4fdc6f1c532"
server_key_iv: "7a97eecc72e7e434dcc58085979cee00"
server_key_version: "encryptionkey@0"
I20260807 22:50:06.296278 26792 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:50:06.298574 26808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:06.299677 26792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:06.299811 26792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/wal
uuid: "a0bd975fe41345b6a345461665d561c9"
format_stamp: "Formatted at 2026-08-07 22:50:06 on dist-test-slave-tm1g"
server_key: "f92ea66430d4e6989115a4fdc6f1c532"
server_key_iv: "7a97eecc72e7e434dcc58085979cee00"
server_key_version: "encryptionkey@0"
I20260807 22:50:06.299916 26792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:06.311932 26792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:06.315001 26792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:06.315192 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:06.321667 26792 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.253:40517
I20260807 22:50:06.321975 26862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.253:40517 every 8 connection(s)
I20260807 22:50:06.322625 26792 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
I20260807 22:50:06.325280 26863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:06.328863 26863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:50:06.329497 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 26792
I20260807 22:50:06.329665 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-1/wal/instance
I20260807 22:50:06.329952 12739 external_mini_cluster.cc:1428] Setting key d3048c4e1afeccb2bb3f8ed7ecdbef18
WARNING: no policy specified for kudu/127.12.112.252@KRBTEST.COM; defaulting to no policy
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.252@KRBTEST.COM" created.
I20260807 22:50:06.342521 26788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.330806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54270 (local address 127.12.112.254:39137)
0807 22:50:06.330937 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.330942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.331819 (+ 877us) server_negotiation.cc:407] Connection header received
0807 22:50:06.333139 (+ 1320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.333142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.333194 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.333267 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.334422 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.334963 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.336128 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.336366 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.336483 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.338914 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.338917 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.338919 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.338951 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.340385 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.340933 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.340939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.340941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.341039 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.341355 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.341361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.341366 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.341637 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.341748 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.342200 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.342347 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:50:06.343277 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.331205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39137 (local address 127.0.0.1:54270)
0807 22:50:06.331669 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.331709 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:06.332889 (+ 1180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:06.333478 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:06.333484 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:06.333795 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:06.334234 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.334246 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.335100 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.335103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.335984 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.335993 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.336520 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.336525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.336693 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.337273 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:06.337289 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:06.338756 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:06.340521 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.340530 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.340545 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.340829 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.341141 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.341143 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.341144 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.341264 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.341742 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:06.341747 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:06.341954 (+ 207us) client_negotiation.cc:769] Sending connection context
0807 22:50:06.342136 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 22:50:06.342459 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":153,"threads_started":1}
I20260807 22:50:06.344686 26863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
I20260807 22:50:06.353785 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.345139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:40517 (local address 127.0.0.1:50724)
0807 22:50:06.345602 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.345616 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:06.345696 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:06.346038 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:06.346041 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:06.346204 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:06.346290 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.346295 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.347235 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.347241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.347765 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.347773 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.348340 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.348343 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.348468 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.348899 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:06.348912 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:06.350474 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:06.352284 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.352289 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.352291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.352483 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.352763 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.352768 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.352770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.352853 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.353277 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:06.353280 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:06.353359 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 22:50:06.353492 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 22:50:06.353611 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":4}
I20260807 22:50:06.353837 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.345277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50724 (local address 127.12.112.253:40517)
0807 22:50:06.345585 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.345596 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.345667 (+ 71us) server_negotiation.cc:407] Connection header received
0807 22:50:06.345769 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.345774 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.345921 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.346058 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.346423 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.347122 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.347881 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.348229 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.348343 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.350598 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.350612 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.350622 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.350642 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.352159 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.352590 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.352595 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.352596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.352674 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.352948 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.352951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.352952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.353167 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.353299 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.353576 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.353690 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":215,"thread_start_us":154,"threads_started":1}
I20260807 22:50:06.355468 26863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab.
Entry for principal kudu/127.12.112.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab.
I20260807 22:50:06.356208 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.355925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39022)
0807 22:50:06.356033 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.356131 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 22:50:06.356411 26811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
I20260807 22:50:06.356774 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.252:45167
--webserver_interface=127.12.112.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab
--principal=kudu/127.12.112.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:42643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:39137,127.12.112.253:40517,127.12.112.252:45167
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:50:06.357316 26784 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } attempt: 3
I20260807 22:50:06.357470 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.357184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39038)
0807 22:50:06.357318 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.357381 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 22:50:06.357649 26863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:45167: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
I20260807 22:50:06.366695 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.357788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50726 (local address 127.12.112.253:40517)
0807 22:50:06.357914 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.357918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.358030 (+ 112us) server_negotiation.cc:407] Connection header received
0807 22:50:06.358147 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.358151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.358202 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.358287 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.358711 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.359495 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.361268 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.361499 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.361576 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.363713 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.363717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.363719 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.363748 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.365088 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.365519 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.365523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.365525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.365601 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.365880 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.365883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.365885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.366044 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.366147 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.366449 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.366557 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:50:06.366706 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.357731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:40517 (local address 127.0.0.1:50726)
0807 22:50:06.357940 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.357957 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:06.358062 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:06.358351 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:06.358354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:06.358506 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:06.358600 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.358605 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.359604 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.359611 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.361142 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.361156 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.361616 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.361623 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.361771 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.362207 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:06.362229 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:06.363585 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:06.365201 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.365205 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.365207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.365415 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.365693 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.365697 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.365699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.365782 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.366140 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:06.366143 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:06.366241 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 22:50:06.366395 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 22:50:06.366550 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260807 22:50:06.368276 26784 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:50:06.368916 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.368700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39040)
0807 22:50:06.368806 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.368854 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 22:50:06.369585 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.369342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39048)
0807 22:50:06.369485 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.369535 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 22:50:06.369726 26784 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:45167: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
I20260807 22:50:06.400959 26784 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } attempt: 1
I20260807 22:50:06.401787 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.401506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39054)
0807 22:50:06.401652 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.401711 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 22:50:06.402508 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.402270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39058)
0807 22:50:06.402397 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.402448 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260807 22:50:06.402634 26784 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:45167: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
I20260807 22:50:06.406860 26863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } attempt: 1
I20260807 22:50:06.407546 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.407232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39064)
0807 22:50:06.407369 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.407452 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 22:50:06.408275 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.408039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39078)
0807 22:50:06.408155 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.408212 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 22:50:06.408433 26863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:45167: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
W20260807 22:50:06.468070 26870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:06.468304 26870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:06.468343 26870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:06.472275 26870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:50:06.472326 26870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:06.472345 26870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:06.472361 26870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:50:06.472376 26870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:50:06.476608 26863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } attempt: 2
I20260807 22:50:06.477454 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.477106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39082)
0807 22:50:06.477277 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.477350 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 22:50:06.477818 26784 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } attempt: 2
I20260807 22:50:06.478008 26870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:42643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:39137,127.12.112.253:40517,127.12.112.252:45167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab
--principal=kudu/127.12.112.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.252:45167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.112.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:06.478257 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.478035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39090)
0807 22:50:06.478142 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.478195 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 22:50:06.478405 26863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:45167: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
I20260807 22:50:06.478511 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.478206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39106)
0807 22:50:06.478352 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.478420 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 22:50:06.479243 26870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:06.479274 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.479039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39116)
0807 22:50:06.479155 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.479207 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 22:50:06.479406 26784 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:45167: Network error: Client connection negotiation failed: client connection to 127.12.112.252:45167: connect: Connection refused (error 111)
I20260807 22:50:06.480271 26870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:06.488503 26876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:06.488435 26875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:06.488538 26870 server_base.cc:1034] running on GCE node
W20260807 22:50:06.488435 26878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:06.489279 26870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:06.490368 26870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:06.491551 26870 hybrid_clock.cc:648] HybridClock initialized: now 1786143006491530 us; error 30 us; skew 500 ppm
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:06.494441 26870 init.cc:377] Logged in from keytab as kudu/127.12.112.252@KRBTEST.COM (short username kudu)
I20260807 22:50:06.495404 26870 webserver.cc:460] Webserver started at http://127.12.112.252:33899/ using document root <none> and password file <none>
I20260807 22:50:06.495954 26870 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:06.496013 26870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:06.496248 26870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:06.498279 26870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/data/instance:
uuid: "20c45db55b4742abb1cc4b4cdf58d6aa"
format_stamp: "Formatted at 2026-08-07 22:50:06 on dist-test-slave-tm1g"
server_key: "0453721a8ba2978154f72d519a0dd162"
server_key_iv: "23a20bca7a7ecad4a8a159e6e470c266"
server_key_version: "encryptionkey@0"
I20260807 22:50:06.498919 26870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/wal/instance:
uuid: "20c45db55b4742abb1cc4b4cdf58d6aa"
format_stamp: "Formatted at 2026-08-07 22:50:06 on dist-test-slave-tm1g"
server_key: "0453721a8ba2978154f72d519a0dd162"
server_key_iv: "23a20bca7a7ecad4a8a159e6e470c266"
server_key_version: "encryptionkey@0"
I20260807 22:50:06.502552 26870 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:50:06.504989 26888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:06.506501 26870 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:50:06.506626 26870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/wal
uuid: "20c45db55b4742abb1cc4b4cdf58d6aa"
format_stamp: "Formatted at 2026-08-07 22:50:06 on dist-test-slave-tm1g"
server_key: "0453721a8ba2978154f72d519a0dd162"
server_key_iv: "23a20bca7a7ecad4a8a159e6e470c266"
server_key_version: "encryptionkey@0"
I20260807 22:50:06.506740 26870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:06.515528 26870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:06.518606 26870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:06.518792 26870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:06.525408 26870 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.252:45167
I20260807 22:50:06.525719 26942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.252:45167 every 8 connection(s)
I20260807 22:50:06.526386 26870 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
I20260807 22:50:06.529060 26943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:06.532707 26943 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:50:06.533545 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 26870
I20260807 22:50:06.533687 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142843719124-12739-0/minicluster-data/master-2/wal/instance
I20260807 22:50:06.533991 12739 external_mini_cluster.cc:1428] Setting key 2e795830a188bdab7edd077bb027fb48
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
I20260807 22:50:06.546005 26788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.534626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54280 (local address 127.12.112.254:39137)
0807 22:50:06.534760 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.534765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.535689 (+ 924us) server_negotiation.cc:407] Connection header received
0807 22:50:06.536445 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.536449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.536512 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.536603 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.537547 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.538040 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.539139 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.539391 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.539474 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.542234 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.542237 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.542239 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.542262 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.543897 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.544490 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.544494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.544498 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.544579 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.544915 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.544920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.544921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.545120 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.545232 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.545702 (+ 470us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.545832 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:50:06.546828 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.535044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39137 (local address 127.0.0.1:54280)
0807 22:50:06.535553 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.535589 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:06.536228 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:06.536685 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:06.536690 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:06.537101 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:06.537397 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.537411 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.538149 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.538153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.539013 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.539022 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.539530 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.539536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.539773 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.540487 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:06.540501 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:06.542061 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:06.544021 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.544031 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.544040 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.544377 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.544675 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.544678 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.544680 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.544817 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.545230 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:06.545236 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:06.545484 (+ 248us) client_negotiation.cc:769] Sending connection context
0807 22:50:06.545656 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 22:50:06.545940 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":67,"spinlock_wait_cycles":6400,"thread_start_us":197,"threads_started":1}
I20260807 22:50:06.546824 26946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.535044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39120 (local address 127.12.112.252:45167)
0807 22:50:06.535437 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.535463 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.535501 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:50:06.536216 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.536233 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.536414 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.536558 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.537320 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.538286 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.539175 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.539578 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.539745 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.542676 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.542685 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.542697 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.542726 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.544435 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.544887 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.544893 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.544895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.544980 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.545274 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.545278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.545280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.545532 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.545724 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.545968 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.546202 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":268,"thread_start_us":106,"threads_started":1}
I20260807 22:50:06.548059 26943 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:06.556769 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.548551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:40517 (local address 127.0.0.1:50742)
0807 22:50:06.548670 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.548684 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:06.548755 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:06.548995 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:06.548998 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:06.549158 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:06.549274 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.549281 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.550004 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.550010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.550612 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.550621 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.551083 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.551086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.551184 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.551656 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:06.551669 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:06.553094 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:06.555282 (+ 2188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.555285 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.555286 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.555488 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.555797 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.555799 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.555800 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.555872 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.556258 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:06.556264 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:06.556361 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 22:50:06.556449 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:50:06.556594 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 22:50:06.556826 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.548680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50742 (local address 127.12.112.253:40517)
0807 22:50:06.548792 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.548795 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.548807 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:50:06.548845 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.548847 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.548883 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.548950 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.549396 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.549892 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.550742 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.550971 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.551082 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.553236 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.553242 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.553249 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.553281 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.555045 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.555594 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.555599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.555601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.555694 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.555964 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.555969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.555970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.556155 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.556230 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.556549 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.556642 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 22:50:06.557539 26943 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:50:06.557971 26788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.549355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54290 (local address 127.12.112.254:39137)
0807 22:50:06.549472 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.549476 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.549495 (+ 19us) server_negotiation.cc:407] Connection header received
0807 22:50:06.549522 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.549524 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.549554 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.549642 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.550215 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.550756 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.551578 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.551945 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.552070 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.554426 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.554431 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.554435 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.554466 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.555880 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.556303 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.556306 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.556308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.556393 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.556704 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.556707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.556709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.557231 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.557487 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.557656 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.557778 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
I20260807 22:50:06.566376 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.557995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39128)
0807 22:50:06.558255 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.558269 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:06.558400 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:06.558765 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:06.558768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:06.558930 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:06.559045 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.559051 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.560089 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.560092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.560880 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.560889 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.561472 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.561475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.561535 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.561949 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:06.561962 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:06.563158 (+ 1196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:06.564973 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.564977 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.564979 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.565163 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.565445 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.565448 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.565450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.565528 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.565869 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:06.565872 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:06.565966 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 22:50:06.566067 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 22:50:06.566197 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206}
I20260807 22:50:06.566478 26946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.558060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39128 (local address 127.12.112.252:45167)
0807 22:50:06.558166 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.558169 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.558348 (+ 179us) server_negotiation.cc:407] Connection header received
0807 22:50:06.558494 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.558496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.558550 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.558632 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.559167 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.559943 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.561001 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.561360 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.561470 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.563299 (+ 1829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.563304 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.563308 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.563338 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.564862 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.565267 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.565272 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.565274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.565352 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.565613 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.565618 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.565620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.565778 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.565878 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.566113 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.566253 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":50}
I20260807 22:50:06.568130 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.559171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50746 (local address 127.12.112.253:40517)
0807 22:50:06.559267 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.559270 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.559290 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:50:06.559346 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.559348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.559378 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.559436 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.560100 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.560880 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.561878 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.562218 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.562432 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.564925 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.564933 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.564935 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.564955 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.566506 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.566966 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.566970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.566972 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.567057 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.567344 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.567347 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.567349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.567519 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.567737 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.567866 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.567976 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 22:50:06.569578 26863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } attempt: 3
I20260807 22:50:06.570123 26943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa: Bootstrap starting.
I20260807 22:50:06.571676 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:50:06.572914 26943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:06.573868 26943 log.cc:824] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
I20260807 22:50:06.576478 26943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa: No bootstrap required, opened a new log
I20260807 22:50:06.578565 26784 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } attempt: 3
I20260807 22:50:06.580292 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.569943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39136)
0807 22:50:06.570046 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.570060 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:06.570134 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:06.570437 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:06.570440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:06.570615 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:06.570706 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.570711 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.571620 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.571623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.572366 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.572377 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.573018 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.573022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.573112 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.573586 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:06.573599 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:06.575099 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:06.578558 (+ 3459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.578561 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.578563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.578814 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.579126 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.579132 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.579135 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.579227 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.579767 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:06.579771 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:06.579884 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 22:50:06.579977 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 22:50:06.580117 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 22:50:06.580894 26946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.570006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39136 (local address 127.12.112.252:45167)
0807 22:50:06.570104 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.570108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.570122 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:50:06.570225 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.570228 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.570266 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.570416 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.570816 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.571483 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.572514 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.572852 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.573327 (+ 475us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.575237 (+ 1910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.575241 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.575243 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.575265 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.578427 (+ 3162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.578933 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.578936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.578938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.579016 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.579356 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.579360 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.579365 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.579639 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.580568 (+ 929us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.580645 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.580742 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:50:06.580947 26943 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } }
I20260807 22:50:06.581192 26943 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:06.581245 26943 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c45db55b4742abb1cc4b4cdf58d6aa, State: Initialized, Role: FOLLOWER
I20260807 22:50:06.581753 26943 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } }
I20260807 22:50:06.583139 26943 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:50:06.583889 26863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9: Bootstrap starting.
Aug 07 22:50:06 dist-test-slave-tm1g krb5kdc[26698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
I20260807 22:50:06.586684 26863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:06.587539 26863 log.cc:824] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9: Log is configured to *not* fsync() on all Append() calls
W20260807 22:50:06.588373 26969 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:50:06.588465 26969 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:50:06.589037 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.574240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50748 (local address 127.12.112.253:40517)
0807 22:50:06.574364 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.574369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.574588 (+ 219us) server_negotiation.cc:407] Connection header received
0807 22:50:06.574772 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.574777 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.574820 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.574890 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.575785 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.576518 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.580850 (+ 4332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.581180 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.581250 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.584802 (+ 3552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.584807 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.584811 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.584834 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.586774 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.587325 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.587329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.587330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.587411 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.587758 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.587761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.587763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.587949 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.588091 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.588704 (+ 613us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.588830 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:50:06.587212 26870 master_runner.cc:186] Error getting master registration for 127.12.112.254:39137: OK, instance_id { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" instance_seqno: 1786143006115581 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:50:06.591454 26870 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:50:06.593219 26788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.573765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54298 (local address 127.12.112.254:39137)
0807 22:50:06.573882 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.573885 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.574938 (+ 1053us) server_negotiation.cc:407] Connection header received
0807 22:50:06.575130 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.575136 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.575190 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.575241 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.576432 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.577133 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.577888 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.578227 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.578377 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.583241 (+ 4864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.583244 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.583247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.583270 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.591286 (+ 8016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.591826 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.591829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.591831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.591919 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.592253 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.592256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.592258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.592483 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.592583 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.592956 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.593072 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:50:06.595283 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.578921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:45167 (local address 127.0.0.1:39150)
0807 22:50:06.579164 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:06.579177 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:06.579248 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:06.581242 (+ 1994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:06.581245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:06.581442 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:06.581537 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.581543 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.582597 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.582602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.583430 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:06.583442 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.584104 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.584109 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:06.584223 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.584596 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:06.584613 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:06.591663 (+ 7050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:06.593722 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.593726 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.593728 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.593981 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.594297 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:06.594325 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:06.594327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:06.594418 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:06.594877 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:06.594882 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:06.594999 (+ 117us) client_negotiation.cc:769] Sending connection context
0807 22:50:06.595087 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:50:06.595182 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177}
I20260807 22:50:06.595438 26946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.579369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39150 (local address 127.12.112.252:45167)
0807 22:50:06.581028 (+ 1659us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.581032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.581043 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:50:06.581073 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.581076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.581110 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.581643 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.581721 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.582447 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.583594 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.583957 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.584429 (+ 472us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.591805 (+ 7376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.591810 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.591813 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.591838 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.593607 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.594102 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.594105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.594107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.594193 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.594557 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.594561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.594562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.594763 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.594863 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.595174 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.595285 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1608,"thread_start_us":90,"threads_started":1}
I20260807 22:50:06.596367 26958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } } }
I20260807 22:50:06.596500 26958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:50:06.597371 26863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9: No bootstrap required, opened a new log
I20260807 22:50:06.598488 26784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10: Bootstrap starting.
I20260807 22:50:06.600593 26957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:06.574462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39140 (local address 127.12.112.252:45167)
0807 22:50:06.579654 (+ 5192us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:06.579662 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:06.579675 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:50:06.579706 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:06.579709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:06.579749 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:06.579829 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:06.580656 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.588429 (+ 7773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.589414 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:06.589776 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:06.589891 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:06.593217 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:06.593221 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:06.593227 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:06.593254 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:06.596157 (+ 2903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.598875 (+ 2718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.598878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.598880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.599001 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:06.599297 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:06.599302 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:06.599305 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:06.599520 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:06.599638 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:06.600321 (+ 683us) server_negotiation.cc:299] Negotiation successful
0807 22:50:06.600431 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5114,"thread_start_us":97,"threads_started":1}
I20260807 22:50:06.601212 26784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:06.601439 26863 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } }
I20260807 22:50:06.601673 26863 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:06.601727 26863 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0bd975fe41345b6a345461665d561c9, State: Initialized, Role: FOLLOWER
I20260807 22:50:06.602077 26784 log.cc:824] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:06.602150 26863 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } }
I20260807 22:50:06.602821 26973 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } } }
I20260807 22:50:06.602981 26973 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:50:06.603633 26863 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:50:06.607522 26784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10: No bootstrap required, opened a new log
I20260807 22:50:06.606951 26792 master_runner.cc:186] Error getting master registration for 127.12.112.254:39137: OK, instance_id { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" instance_seqno: 1786143006115581 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:50:06.611560 26792 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:50:06.611575 26784 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } }
I20260807 22:50:06.611799 26784 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:06.611852 26784 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ce6182834e14f63a844341c96c48e10, State: Initialized, Role: FOLLOWER
I20260807 22:50:06.612286 26784 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } }
W20260807 22:50:06.612402 26985 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:50:06.612566 26985 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:50:06.612780 26987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } } }
I20260807 22:50:06.612912 26987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:50:06.613428 26784 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 22:50:06.621021 26998 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:50:06.621194 26998 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:50:06.621299 26713 master_runner.cc:263] No leader master found from master 1ce6182834e14f63a844341c96c48e10
I20260807 22:50:06.621369 26713 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:50:06.769017 26987 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:50:06.769241 26987 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } }
W20260807 22:50:06.770097 26894 tablet.cc:2369] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:50:06.770419 26987 leader_election.cc:288] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0bd975fe41345b6a345461665d561c9 (127.12.112.253:40517), 20c45db55b4742abb1cc4b4cdf58d6aa (127.12.112.252:45167)
I20260807 22:50:06.771173 26835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ce6182834e14f63a844341c96c48e10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0bd975fe41345b6a345461665d561c9" is_pre_election: true
I20260807 22:50:06.771288 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ce6182834e14f63a844341c96c48e10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" is_pre_election: true
I20260807 22:50:06.771485 26835 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ce6182834e14f63a844341c96c48e10 in term 0.
I20260807 22:50:06.771577 26916 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ce6182834e14f63a844341c96c48e10 in term 0.
I20260807 22:50:06.771929 26732 leader_election.cc:302] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ce6182834e14f63a844341c96c48e10, a0bd975fe41345b6a345461665d561c9; no voters:
I20260807 22:50:06.772235 26987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:50:06.772326 26987 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:50:06.772374 26987 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:06.773976 26987 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } }
I20260807 22:50:06.774638 26835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ce6182834e14f63a844341c96c48e10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0bd975fe41345b6a345461665d561c9"
I20260807 22:50:06.774766 26835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:06.776079 26835 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ce6182834e14f63a844341c96c48e10 in term 1.
I20260807 22:50:06.776160 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ce6182834e14f63a844341c96c48e10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa"
I20260807 22:50:06.776281 26916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:06.776403 26732 leader_election.cc:302] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ce6182834e14f63a844341c96c48e10, a0bd975fe41345b6a345461665d561c9; no voters:
I20260807 22:50:06.776806 27000 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:50:06.777531 27000 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [term 1 LEADER]: Becoming Leader. State: Replica: 1ce6182834e14f63a844341c96c48e10, State: Running, Role: LEADER
I20260807 22:50:06.777556 26916 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ce6182834e14f63a844341c96c48e10 in term 1.
I20260807 22:50:06.777860 27000 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } }
I20260807 22:50:06.778069 26987 leader_election.cc:288] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [CANDIDATE]: Term 1 election: Requested vote from peers a0bd975fe41345b6a345461665d561c9 (127.12.112.253:40517), 20c45db55b4742abb1cc4b4cdf58d6aa (127.12.112.252:45167)
I20260807 22:50:06.780151 26987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ce6182834e14f63a844341c96c48e10. Latest consensus state: current_term: 1 leader_uuid: "1ce6182834e14f63a844341c96c48e10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } } }
I20260807 22:50:06.780292 26987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:06.780702 27003 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:50:06.781744 27003 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:50:06.786960 26916 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [term 1 FOLLOWER]: Refusing update from remote peer 1ce6182834e14f63a844341c96c48e10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:06.787012 26835 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [term 1 FOLLOWER]: Refusing update from remote peer 1ce6182834e14f63a844341c96c48e10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:06.787662 27000 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:06.787815 26987 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:06.791373 26958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ce6182834e14f63a844341c96c48e10. Latest consensus state: current_term: 1 leader_uuid: "1ce6182834e14f63a844341c96c48e10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } } }
I20260807 22:50:06.791391 26973 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ce6182834e14f63a844341c96c48e10. Latest consensus state: current_term: 1 leader_uuid: "1ce6182834e14f63a844341c96c48e10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } } }
I20260807 22:50:06.791486 26958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:50:06.791493 26973 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:50:06.795830 26987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1ce6182834e14f63a844341c96c48e10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } } }
I20260807 22:50:06.795962 26987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:06.796265 27005 mvcc.cc:205] Tried to move back new op lower bound from 7316041755792887808 to 7316041755765653504. Current Snapshot: MvccSnapshot[applied={T|T < 7316041755792887808}]
I20260807 22:50:06.796399 26958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1ce6182834e14f63a844341c96c48e10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } } }
I20260807 22:50:06.796509 26958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:50:06.797025 27007 mvcc.cc:205] Tried to move back new op lower bound from 7316041755792887808 to 7316041755765653504. Current Snapshot: MvccSnapshot[applied={T|T < 7316041755792887808}]
I20260807 22:50:06.797938 27000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1ce6182834e14f63a844341c96c48e10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } } }
I20260807 22:50:06.798049 27000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10 [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:06.798764 26973 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1ce6182834e14f63a844341c96c48e10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ce6182834e14f63a844341c96c48e10" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39137 } } peers { permanent_uuid: "a0bd975fe41345b6a345461665d561c9" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 40517 } } peers { permanent_uuid: "20c45db55b4742abb1cc4b4cdf58d6aa" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 45167 } } }
I20260807 22:50:06.798887 26973 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:50:06.799439 27006 mvcc.cc:205] Tried to move back new op lower bound from 7316041755792887808 to 7316041755765653504. Current Snapshot: MvccSnapshot[applied={T|T < 7316041755792887808}]
I20260807 22:50:06.800884 27003 catalog_manager.cc:1347] Generated new cluster ID: ffba203a92de478b93afecb4b60d8077
I20260807 22:50:06.800942 27003 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:50:06.836047 27003 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:50:06.837056 27003 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:50:06.848783 27003 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ce6182834e14f63a844341c96c48e10: Generated new TSK 0
I20260807 22:50:06.849650 27003 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:50:07.589843 26969 catalog_manager.cc:1259] Loaded cluster ID: ffba203a92de478b93afecb4b60d8077
I20260807 22:50:07.589954 26969 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa: loading cluster ID for follower catalog manager: success
I20260807 22:50:07.591673 26969 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa: acquiring CA information for follower catalog manager: success
I20260807 22:50:07.592787 26969 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 20c45db55b4742abb1cc4b4cdf58d6aa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:50:07.614078 26985 catalog_manager.cc:1259] Loaded cluster ID: ffba203a92de478b93afecb4b60d8077
I20260807 22:50:07.614187 26985 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9: loading cluster ID for follower catalog manager: success
I20260807 22:50:07.616189 26985 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9: acquiring CA information for follower catalog manager: success
I20260807 22:50:07.617317 26985 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a0bd975fe41345b6a345461665d561c9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:50:07.913374 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 26713
I20260807 22:50:07.921810 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 26792
I20260807 22:50:07.929021 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 26870
2026-08-07T22:50:07Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3184 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:50:07 dist-test-slave-tm1g krb5kdc[27019](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:50:07 dist-test-slave-tm1g krb5kdc[27019](info): set up 2 sockets
Aug 07 22:50:07 dist-test-slave-tm1g krb5kdc[27019](info): commencing operation
krb5kdc: starting...
W20260807 22:50:09.002164 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:50:09 dist-test-slave-tm1g krb5kdc[27019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:50:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:50:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:50:09.123446 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:43557
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:46435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:43557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:09.234447 27032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:09.234678 27032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:09.234717 27032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:09.238581 27032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:50:09.238639 27032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:09.238658 27032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:09.238674 27032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:50:09.238689 27032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:50:09.243721 27032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:46435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:43557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:43557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:09.244647 27032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:09.245587 27032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:50:09.254037 27032 server_base.cc:1034] running on GCE node
W20260807 22:50:09.253943 27040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:09.253953 27037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:09.253943 27038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:09.254803 27032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:09.256012 27032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:09.257215 27032 hybrid_clock.cc:648] HybridClock initialized: now 1786143009257195 us; error 35 us; skew 500 ppm
Aug 07 22:50:09 dist-test-slave-tm1g krb5kdc[27019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143009, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:09.267148 27032 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:50:09.268682 27032 webserver.cc:460] Webserver started at http://127.12.112.254:34395/ using document root <none> and password file <none>
I20260807 22:50:09.269408 27032 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:09.269542 27032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:09.269897 27032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:09.273017 27032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "7c78cd3299c64e5987a8c0f77db9feaf"
format_stamp: "Formatted at 2026-08-07 22:50:09 on dist-test-slave-tm1g"
server_key: "99226557a339a6ed8f67e5157137e3d5"
server_key_iv: "79d57619f69cf8f2e484b9f1dce12cbc"
server_key_version: "encryptionkey@0"
I20260807 22:50:09.273794 27032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "7c78cd3299c64e5987a8c0f77db9feaf"
format_stamp: "Formatted at 2026-08-07 22:50:09 on dist-test-slave-tm1g"
server_key: "99226557a339a6ed8f67e5157137e3d5"
server_key_iv: "79d57619f69cf8f2e484b9f1dce12cbc"
server_key_version: "encryptionkey@0"
I20260807 22:50:09.278640 27032 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 22:50:09.281994 27048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:09.283370 27032 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:50:09.283490 27032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "7c78cd3299c64e5987a8c0f77db9feaf"
format_stamp: "Formatted at 2026-08-07 22:50:09 on dist-test-slave-tm1g"
server_key: "99226557a339a6ed8f67e5157137e3d5"
server_key_iv: "79d57619f69cf8f2e484b9f1dce12cbc"
server_key_version: "encryptionkey@0"
I20260807 22:50:09.283584 27032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:09.311384 27032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:09.314206 27032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:09.314437 27032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:09.321524 27032 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:43557
I20260807 22:50:09.321543 27105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:43557 every 8 connection(s)
I20260807 22:50:09.322505 27032 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:50:09.325232 27106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:09.329838 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 27032
I20260807 22:50:09.329993 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:50:09.330274 12739 external_mini_cluster.cc:1428] Setting key b3084f7d89138cc7a54dcf3f5b1dc9ff
I20260807 22:50:09.330811 27106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf: Bootstrap starting.
I20260807 22:50:09.333139 27106 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:09.334088 27106 log.cc:824] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:09.336320 27106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf: No bootstrap required, opened a new log
Aug 07 22:50:09 dist-test-slave-tm1g krb5kdc[27019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:09.340579 27106 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c78cd3299c64e5987a8c0f77db9feaf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43557 } }
I20260807 22:50:09.340795 27106 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:09.340909 27106 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c78cd3299c64e5987a8c0f77db9feaf, State: Initialized, Role: FOLLOWER
I20260807 22:50:09.341382 27106 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c78cd3299c64e5987a8c0f77db9feaf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43557 } }
I20260807 22:50:09.341542 27106 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:50:09.341629 27106 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:50:09.341747 27106 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:09.342693 27106 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c78cd3299c64e5987a8c0f77db9feaf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43557 } }
I20260807 22:50:09.343029 27106 leader_election.cc:302] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c78cd3299c64e5987a8c0f77db9feaf; no voters:
I20260807 22:50:09.343338 27106 leader_election.cc:288] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:50:09.343441 27112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:50:09.343664 27112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [term 1 LEADER]: Becoming Leader. State: Replica: 7c78cd3299c64e5987a8c0f77db9feaf, State: Running, Role: LEADER
I20260807 22:50:09.344038 27112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c78cd3299c64e5987a8c0f77db9feaf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43557 } }
I20260807 22:50:09.344677 27106 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:50:09.345299 27114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c78cd3299c64e5987a8c0f77db9feaf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c78cd3299c64e5987a8c0f77db9feaf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43557 } } }
I20260807 22:50:09.345279 27113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c78cd3299c64e5987a8c0f77db9feaf. Latest consensus state: current_term: 1 leader_uuid: "7c78cd3299c64e5987a8c0f77db9feaf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c78cd3299c64e5987a8c0f77db9feaf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43557 } } }
I20260807 22:50:09.345383 27109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:09.331587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44572 (local address 127.12.112.254:43557)
0807 22:50:09.331989 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:09.332005 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:09.332040 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:50:09.332662 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:09.332679 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:09.332993 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:09.333304 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:09.334226 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:09.335499 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:09.336625 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:09.337082 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:09.337206 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:09.340020 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:09.340025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:09.340037 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:09.340063 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:09.342035 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:09.342550 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:09.342556 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:09.342562 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:09.342680 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:09.342971 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:09.342975 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:09.342976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:09.343495 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:09.343753 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:09.344015 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 22:50:09.344313 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":132,"threads_started":1}
I20260807 22:50:09.345429 27114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:09.345429 27113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:09.348441 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 22:50:09.349738 27127 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:50:09.349815 27127 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:50:09.349872 27118 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:50:09.350698 27118 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:50:09.355475 27118 catalog_manager.cc:1347] Generated new cluster ID: 6a4f927b745a45b5ae2481f8c17fd1ca
I20260807 22:50:09.355540 27118 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:50:09.392222 27118 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:50:09.393170 27118 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:50:09.397706 27118 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c78cd3299c64e5987a8c0f77db9feaf: Generated new TSK 0
I20260807 22:50:09.398396 27118 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:50:09.404580 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 27032
2026-08-07T22:50:09Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1474 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:50:09 dist-test-slave-tm1g krb5kdc[27134](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:50:09 dist-test-slave-tm1g krb5kdc[27134](info): set up 2 sockets
Aug 07 22:50:09 dist-test-slave-tm1g krb5kdc[27134](info): commencing operation
krb5kdc: starting...
W20260807 22:50:10.461687 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:50:10 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:50:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:50:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:50:10.581705 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36567
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:36567
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:10.688755 27148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:10.688987 27148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:10.689024 27148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:10.692993 27148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:50:10.693044 27148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:10.693063 27148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:10.693079 27148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:50:10.693117 27148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:50:10.698153 27148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:36567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:10.699137 27148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:10.700098 27148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:10.708355 27154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:10.708360 27156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:10.708428 27148 server_base.cc:1034] running on GCE node
W20260807 22:50:10.708388 27153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:10.709103 27148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:10.710143 27148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:10.711359 27148 hybrid_clock.cc:648] HybridClock initialized: now 1786143010711333 us; error 43 us; skew 500 ppm
Aug 07 22:50:10 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143010, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:10.714036 27148 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:50:10.714932 27148 webserver.cc:460] Webserver started at http://127.12.112.254:33037/ using document root <none> and password file <none>
I20260807 22:50:10.715473 27148 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:10.715562 27148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:10.715795 27148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:10.717751 27148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "6d140683bfb140b19f644a141ee12617"
format_stamp: "Formatted at 2026-08-07 22:50:10 on dist-test-slave-tm1g"
server_key: "917c731702fcf04be115745d3115a852"
server_key_iv: "7390b8ba7f044c54ab46805bdfca95b8"
server_key_version: "encryptionkey@0"
I20260807 22:50:10.718345 27148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "6d140683bfb140b19f644a141ee12617"
format_stamp: "Formatted at 2026-08-07 22:50:10 on dist-test-slave-tm1g"
server_key: "917c731702fcf04be115745d3115a852"
server_key_iv: "7390b8ba7f044c54ab46805bdfca95b8"
server_key_version: "encryptionkey@0"
I20260807 22:50:10.721760 27148 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:50:10.724066 27164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:10.725265 27148 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:10.725404 27148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "6d140683bfb140b19f644a141ee12617"
format_stamp: "Formatted at 2026-08-07 22:50:10 on dist-test-slave-tm1g"
server_key: "917c731702fcf04be115745d3115a852"
server_key_iv: "7390b8ba7f044c54ab46805bdfca95b8"
server_key_version: "encryptionkey@0"
I20260807 22:50:10.725508 27148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:10.747761 27148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:10.750603 27148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:10.750806 27148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:10.757768 27148 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:36567
I20260807 22:50:10.758064 27220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:36567 every 8 connection(s)
I20260807 22:50:10.758746 27148 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:50:10.761343 27221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:10.766639 27221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Bootstrap starting.
I20260807 22:50:10.767423 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 27148
I20260807 22:50:10.767561 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:50:10.767894 12739 external_mini_cluster.cc:1428] Setting key bb56593d28d6da61cb3f5e771b3f8278
I20260807 22:50:10.769569 27221 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:10.770283 27221 log.cc:824] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:10.772352 27221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: No bootstrap required, opened a new log
I20260807 22:50:10.775377 27221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:10.775578 27221 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:10.775647 27221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d140683bfb140b19f644a141ee12617, State: Initialized, Role: FOLLOWER
I20260807 22:50:10.776144 27221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:10.776270 27221 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:50:10.776350 27221 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:50:10.776467 27221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:10.777307 27221 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
Aug 07 22:50:10 dist-test-slave-tm1g krb5kdc[27134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:10.777658 27221 leader_election.cc:302] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d140683bfb140b19f644a141ee12617; no voters:
I20260807 22:50:10.778002 27221 leader_election.cc:288] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:50:10.778119 27226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:50:10.778369 27226 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 1 LEADER]: Becoming Leader. State: Replica: 6d140683bfb140b19f644a141ee12617, State: Running, Role: LEADER
I20260807 22:50:10.778677 27226 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:10.779371 27221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:50:10.779928 27226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d140683bfb140b19f644a141ee12617. Latest consensus state: current_term: 1 leader_uuid: "6d140683bfb140b19f644a141ee12617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } } }
I20260807 22:50:10.780170 27226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:10.780310 27227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d140683bfb140b19f644a141ee12617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } } }
I20260807 22:50:10.780413 27227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:10.780701 27234 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:50:10.783792 27234 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:50:10.784056 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:10.769091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35880 (local address 127.12.112.254:36567)
0807 22:50:10.769504 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:10.769525 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:10.769559 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:50:10.770214 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:10.770230 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:10.770638 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:10.770966 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:10.771751 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:10.773316 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:10.774186 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:10.775191 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:10.775368 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:10.778233 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:10.778241 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:10.778257 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:10.778288 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:10.780499 (+ 2211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:10.781038 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:10.781044 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:10.781052 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:10.781216 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:10.781586 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:10.781590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:10.781592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:10.782159 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:10.782389 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:10.782756 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 22:50:10.783132 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":144,"threads_started":1}
I20260807 22:50:10.789722 27234 catalog_manager.cc:1347] Generated new cluster ID: 18110d1f0d4a47e1bf331c9eab51daeb
I20260807 22:50:10.789786 27234 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:50:10.802471 27234 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:50:10.803435 27234 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:50:10.810197 27234 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Generated new TSK 0
I20260807 22:50:10.811041 27234 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:50:10.845067 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36567
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:10.955014 27248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:10.955282 27248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:10.955368 27248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:10.959301 27248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:10.959380 27248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:10.959472 27248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:50:10.964469 27248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:10.965739 27248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:10.967129 27248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:10.976725 27253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:10.976785 27255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:10.976748 27248 server_base.cc:1034] running on GCE node
W20260807 22:50:10.976835 27257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:10.977321 27248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:10.977864 27248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:10.979015 27248 hybrid_clock.cc:648] HybridClock initialized: now 1786143010979003 us; error 25 us; skew 500 ppm
Aug 07 22:50:10 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143010, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:10.981784 27248 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:50:10.982622 27248 webserver.cc:460] Webserver started at http://127.12.112.193:46133/ using document root <none> and password file <none>
I20260807 22:50:10.983112 27248 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:10.983167 27248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:10.983332 27248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:10.985200 27248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "73e6030a0a464de29d254f53c321f340"
format_stamp: "Formatted at 2026-08-07 22:50:10 on dist-test-slave-tm1g"
server_key: "063289d925db46f7f47af07548794626"
server_key_iv: "22d7cf06c0bb95efca9dced9da055703"
server_key_version: "encryptionkey@0"
I20260807 22:50:10.985723 27248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "73e6030a0a464de29d254f53c321f340"
format_stamp: "Formatted at 2026-08-07 22:50:10 on dist-test-slave-tm1g"
server_key: "063289d925db46f7f47af07548794626"
server_key_iv: "22d7cf06c0bb95efca9dced9da055703"
server_key_version: "encryptionkey@0"
I20260807 22:50:10.989274 27248 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:50:10.991572 27264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:10.992733 27248 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:50:10.992873 27248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "73e6030a0a464de29d254f53c321f340"
format_stamp: "Formatted at 2026-08-07 22:50:10 on dist-test-slave-tm1g"
server_key: "063289d925db46f7f47af07548794626"
server_key_iv: "22d7cf06c0bb95efca9dced9da055703"
server_key_version: "encryptionkey@0"
I20260807 22:50:10.992980 27248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:11.032217 27248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:11.035602 27248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:11.035830 27248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:11.036441 27248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:11.037268 27248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:11.037344 27248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:11.037421 27248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:11.037464 27248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:11.046078 27248 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:40613
I20260807 22:50:11.046115 27383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:40613 every 8 connection(s)
I20260807 22:50:11.046955 27248 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:50:11.052363 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 27248
I20260807 22:50:11.052501 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:50:11.052801 12739 external_mini_cluster.cc:1428] Setting key 2c18a3f30ff16cddde50da5f62536c0c
Aug 07 22:50:11 dist-test-slave-tm1g krb5kdc[27134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143010, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:11.061206 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.048695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:42701 (local address 127.12.112.254:36567)
0807 22:50:11.048855 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:11.048860 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:11.049722 (+ 862us) server_negotiation.cc:407] Connection header received
0807 22:50:11.051023 (+ 1301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:11.051026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:11.051071 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:11.051148 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:11.052242 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.053057 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.054666 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.055067 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.055189 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.057562 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:11.057565 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:11.057567 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:11.057590 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:11.059143 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:11.059673 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:11.059677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:11.059679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:11.059766 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:11.060112 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:11.060116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:11.060118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:11.060301 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:11.060412 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:11.060896 (+ 484us) server_negotiation.cc:299] Negotiation successful
0807 22:50:11.061028 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 22:50:11.061980 27386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.049091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:42701)
0807 22:50:11.049562 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:11.049605 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:11.050826 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:11.051271 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:11.051277 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:11.051622 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:11.052083 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.052095 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.053225 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.053229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.054540 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.054549 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.055219 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.055222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.055358 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.055948 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:11.055965 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:11.057393 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:11.059283 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:11.059288 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:11.059302 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:11.059566 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:11.059868 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:11.059872 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:11.059874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:11.060015 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:11.060411 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:11.060417 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:11.060662 (+ 245us) client_negotiation.cc:769] Sending connection context
0807 22:50:11.060848 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 22:50:11.061157 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:50:11.063176 27384 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36567
I20260807 22:50:11.063488 27384 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:11.063966 27384 heartbeater.cc:511] Master 127.12.112.254:36567 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:50:11.065541 27184 ts_manager.cc:194] Registered new tserver with Master: 73e6030a0a464de29d254f53c321f340 (127.12.112.193:40613)
I20260807 22:50:11.066728 27184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:42701
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:50:11.081136 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36567
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:11.192816 27389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:11.193042 27389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:11.193082 27389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:11.197168 27389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:11.197218 27389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:11.197274 27389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:50:11.202343 27389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:11.203255 27389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:11.204260 27389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:11.213925 27394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:11.213980 27395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:11.213959 27389 server_base.cc:1034] running on GCE node
W20260807 22:50:11.214123 27397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:11.214563 27389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:11.215121 27389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:11.216305 27389 hybrid_clock.cc:648] HybridClock initialized: now 1786143011216285 us; error 45 us; skew 500 ppm
Aug 07 22:50:11 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143011, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:11.219045 27389 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:50:11.219856 27389 webserver.cc:460] Webserver started at http://127.12.112.194:44767/ using document root <none> and password file <none>
I20260807 22:50:11.220418 27389 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:11.220510 27389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:11.220734 27389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:11.222770 27389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "3057192b03594be2b48bb855e636656e"
format_stamp: "Formatted at 2026-08-07 22:50:11 on dist-test-slave-tm1g"
server_key: "5a8fd9056aee464e17d0accfe80a6e8f"
server_key_iv: "dca51e0c03c5f67c871a06f68fe634f1"
server_key_version: "encryptionkey@0"
I20260807 22:50:11.223331 27389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "3057192b03594be2b48bb855e636656e"
format_stamp: "Formatted at 2026-08-07 22:50:11 on dist-test-slave-tm1g"
server_key: "5a8fd9056aee464e17d0accfe80a6e8f"
server_key_iv: "dca51e0c03c5f67c871a06f68fe634f1"
server_key_version: "encryptionkey@0"
I20260807 22:50:11.227007 27389 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:50:11.229327 27404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:11.230640 27389 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:50:11.230773 27389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "3057192b03594be2b48bb855e636656e"
format_stamp: "Formatted at 2026-08-07 22:50:11 on dist-test-slave-tm1g"
server_key: "5a8fd9056aee464e17d0accfe80a6e8f"
server_key_iv: "dca51e0c03c5f67c871a06f68fe634f1"
server_key_version: "encryptionkey@0"
I20260807 22:50:11.230899 27389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:11.251590 27389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:11.254570 27389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:11.254773 27389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:11.255365 27389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:11.256193 27389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:11.256268 27389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:11.256343 27389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:11.256397 27389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:11.265530 27389 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:32927
I20260807 22:50:11.265563 27527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:32927 every 8 connection(s)
I20260807 22:50:11.266446 27389 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:50:11.267663 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 27389
I20260807 22:50:11.267824 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:50:11.268146 12739 external_mini_cluster.cc:1428] Setting key 70a5f32f40c46c643dfa86e5c22044a5
Aug 07 22:50:11 dist-test-slave-tm1g krb5kdc[27134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143011, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:50:11.280681 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.268332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:54173 (local address 127.12.112.254:36567)
0807 22:50:11.268501 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:11.268506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:11.269414 (+ 908us) server_negotiation.cc:407] Connection header received
0807 22:50:11.270926 (+ 1512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:11.270932 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:11.270995 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:11.271092 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:11.272294 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.272843 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.274004 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.274239 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.274393 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.276891 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:11.276895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:11.276898 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:11.276931 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:11.278493 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:11.279009 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:11.279013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:11.279015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:11.279099 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:11.279446 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:11.279450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:11.279452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:11.279638 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:11.279749 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:11.280381 (+ 632us) server_negotiation.cc:299] Negotiation successful
0807 22:50:11.280508 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:50:11.281637 27532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.268744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:54173)
0807 22:50:11.269268 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:11.269321 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:11.270707 (+ 1386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:11.271314 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:11.271323 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:11.271672 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:11.272147 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.272161 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.272976 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.272985 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.273869 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.273879 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.274434 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.274439 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.274606 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.275221 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:11.275237 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:11.276670 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:11.278611 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:11.278617 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:11.278630 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:11.278898 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:11.279196 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:11.279200 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:11.279202 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:11.279344 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:11.279801 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:11.279811 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:11.280129 (+ 318us) client_negotiation.cc:769] Sending connection context
0807 22:50:11.280319 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 22:50:11.280658 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":162,"threads_started":1}
I20260807 22:50:11.282874 27528 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36567
I20260807 22:50:11.283128 27528 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:11.283614 27528 heartbeater.cc:511] Master 127.12.112.254:36567 requested a full tablet report, sending...
I20260807 22:50:11.284709 27184 ts_manager.cc:194] Registered new tserver with Master: 3057192b03594be2b48bb855e636656e (127.12.112.194:32927)
I20260807 22:50:11.285293 27184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:54173
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:50:11.295326 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36567
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:11.405462 27535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:11.405704 27535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:11.405745 27535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:11.409658 27535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:11.409715 27535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:11.409777 27535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:50:11.414892 27535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:36567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:11.416148 27535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:11.417227 27535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:11.426656 27543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:11.426659 27540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:11.426703 27541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:11.426998 27535 server_base.cc:1034] running on GCE node
I20260807 22:50:11.427429 27535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:11.427999 27535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:11.429153 27535 hybrid_clock.cc:648] HybridClock initialized: now 1786143011429127 us; error 45 us; skew 500 ppm
Aug 07 22:50:11 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143011, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:11.432046 27535 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:50:11.432871 27535 webserver.cc:460] Webserver started at http://127.12.112.195:42891/ using document root <none> and password file <none>
I20260807 22:50:11.433419 27535 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:11.433521 27535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:11.433753 27535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:11.435978 27535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "0256fb265eb04c929ead8227d87c8e72"
format_stamp: "Formatted at 2026-08-07 22:50:11 on dist-test-slave-tm1g"
server_key: "9d3b8520e54ea65b40337ab9dcdff32c"
server_key_iv: "91c3419bce6c6d6abf1b97e70aa1de87"
server_key_version: "encryptionkey@0"
I20260807 22:50:11.436551 27535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "0256fb265eb04c929ead8227d87c8e72"
format_stamp: "Formatted at 2026-08-07 22:50:11 on dist-test-slave-tm1g"
server_key: "9d3b8520e54ea65b40337ab9dcdff32c"
server_key_iv: "91c3419bce6c6d6abf1b97e70aa1de87"
server_key_version: "encryptionkey@0"
I20260807 22:50:11.440276 27535 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:50:11.442616 27550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:11.443804 27535 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:50:11.443934 27535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "0256fb265eb04c929ead8227d87c8e72"
format_stamp: "Formatted at 2026-08-07 22:50:11 on dist-test-slave-tm1g"
server_key: "9d3b8520e54ea65b40337ab9dcdff32c"
server_key_iv: "91c3419bce6c6d6abf1b97e70aa1de87"
server_key_version: "encryptionkey@0"
I20260807 22:50:11.444036 27535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:11.466946 27535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:11.470256 27535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:11.470487 27535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:11.471107 27535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:11.471941 27535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:11.471987 27535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:11.472059 27535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:11.472100 27535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:11.480684 27535 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:46555
I20260807 22:50:11.480746 27670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:46555 every 8 connection(s)
I20260807 22:50:11.481737 27535 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:50:11 dist-test-slave-tm1g krb5kdc[27134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143011, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:11.491804 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 27535
I20260807 22:50:11.491958 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:50:11.492293 12739 external_mini_cluster.cc:1428] Setting key b711af0acf648c716a195093f6f5d906
I20260807 22:50:11.495633 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.483504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:44759 (local address 127.12.112.254:36567)
0807 22:50:11.483677 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:11.483682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:11.484510 (+ 828us) server_negotiation.cc:407] Connection header received
0807 22:50:11.485822 (+ 1312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:11.485825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:11.485872 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:11.485952 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:11.487285 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.487834 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.489059 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.489304 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.489421 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.491889 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:11.491892 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:11.491894 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:11.491941 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:11.493539 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:11.494140 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:11.494143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:11.494145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:11.494222 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:11.494660 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:11.494663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:11.494665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:11.494870 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:11.494949 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:11.495420 (+ 471us) server_negotiation.cc:299] Negotiation successful
0807 22:50:11.495517 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 22:50:11.496546 27673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.483904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:44759)
0807 22:50:11.484356 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:11.484398 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:11.485612 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:11.486108 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:11.486114 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:11.486576 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:11.487136 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.487150 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.487978 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.487981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.488912 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.488921 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.489480 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.489483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.489623 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.490177 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:11.490194 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:11.491703 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:11.493635 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:11.493641 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:11.493658 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:11.494038 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:11.494336 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:11.494339 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:11.494341 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:11.494538 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:11.494966 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:11.494970 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:11.495196 (+ 226us) client_negotiation.cc:769] Sending connection context
0807 22:50:11.495344 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 22:50:11.495598 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":116,"threads_started":1}
I20260807 22:50:11.497686 27671 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36567
I20260807 22:50:11.497944 27671 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:11.498548 27671 heartbeater.cc:511] Master 127.12.112.254:36567 requested a full tablet report, sending...
I20260807 22:50:11.499558 27184 ts_manager.cc:194] Registered new tserver with Master: 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555)
I20260807 22:50:11.500146 27184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:44759
I20260807 22:50:11.506474 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:50:11.515718 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.508505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35890 (local address 127.12.112.254:36567)
0807 22:50:11.508648 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:11.508655 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:11.508785 (+ 130us) server_negotiation.cc:407] Connection header received
0807 22:50:11.508893 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:11.508896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:11.508934 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:11.509005 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:11.509663 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.510160 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.511015 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.511245 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.511340 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.512618 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:11.512621 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:11.512623 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:11.512646 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:11.513990 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:11.514476 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:11.514479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:11.514480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:11.514553 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:11.514877 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:11.514880 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:11.514881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:11.515104 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:11.515212 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:11.515413 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 22:50:11.515506 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:50:11.518687 27184 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:50:11.521701 27184 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:50:11.536358 27685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.530581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35204 (local address 127.12.112.194:32927)
0807 22:50:11.531217 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:11.531228 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:11.531252 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:50:11.531437 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:11.531443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:11.531665 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:11.531819 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:11.532427 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.533222 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.534868 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.535663 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.535798 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.535946 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:11.536102 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 22:50:11.536196 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":128,"threads_started":1}
I20260807 22:50:11.536345 27686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.530285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:32927 (local address 127.0.0.1:35204)
0807 22:50:11.531069 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:11.531085 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:11.531216 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:11.532031 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:11.532040 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:11.532066 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:11.532274 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.532284 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.533357 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.533363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.534704 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.534715 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.535785 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.535789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.535897 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.535934 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 22:50:11.536073 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 22:50:11.536195 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"mutex_wait_us":59,"thread_start_us":95,"threads_started":1}
I20260807 22:50:11.536863 27687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.530643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40613 (local address 127.0.0.1:41084)
0807 22:50:11.531535 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:11.531549 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:11.531628 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:11.532247 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:11.532250 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:11.532273 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:11.532413 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.532420 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.533866 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.533869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.535183 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.535193 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.536413 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.536416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.536528 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.536551 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:50:11.536628 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:50:11.536701 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"mutex_wait_us":167,"thread_start_us":92,"threads_started":1}
I20260807 22:50:11.536937 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.531174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41084 (local address 127.12.112.193:40613)
0807 22:50:11.531583 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:11.531599 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:11.531620 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:50:11.531788 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:11.531793 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:11.531962 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:11.532102 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:11.532557 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.533696 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.535299 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.536105 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.536227 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.536342 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:11.536678 (+ 336us) server_negotiation.cc:299] Negotiation successful
0807 22:50:11.536780 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":117,"threads_started":1}
I20260807 22:50:11.537030 27683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.530173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:46555 (local address 127.0.0.1:54608)
0807 22:50:11.530977 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:11.531027 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:11.531217 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:11.532137 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:11.532140 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:11.532160 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:11.532344 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.532352 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.533890 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.533893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.535123 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.535140 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.536413 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.536416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.536732 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.536754 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:50:11.536820 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 22:50:11.536879 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":226,"thread_start_us":80,"threads_started":1}
I20260807 22:50:11.537489 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.530366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54608 (local address 127.12.112.195:46555)
0807 22:50:11.530822 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:11.530835 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:11.531123 (+ 288us) server_negotiation.cc:407] Connection header received
0807 22:50:11.531703 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:11.531709 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:11.531902 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:11.532024 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:11.532510 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.533753 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.535248 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.536105 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.536227 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.536350 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:11.537238 (+ 888us) server_negotiation.cc:299] Negotiation successful
0807 22:50:11.537351 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":113,"threads_started":1}
I20260807 22:50:11.539593 27314 tablet_service.cc:1467] Processing CreateTablet for tablet 66760eef752948f7a716a1683384224a (DEFAULT_TABLE table=test-table [id=5597059d5e384d55b4ee653f76041f4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:11.539716 27459 tablet_service.cc:1467] Processing CreateTablet for tablet 66760eef752948f7a716a1683384224a (DEFAULT_TABLE table=test-table [id=5597059d5e384d55b4ee653f76041f4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:11.540237 27600 tablet_service.cc:1467] Processing CreateTablet for tablet 66760eef752948f7a716a1683384224a (DEFAULT_TABLE table=test-table [id=5597059d5e384d55b4ee653f76041f4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:11.540628 27314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66760eef752948f7a716a1683384224a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:11.540737 27459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66760eef752948f7a716a1683384224a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:11.541146 27600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66760eef752948f7a716a1683384224a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:11.547279 27689 tablet_bootstrap.cc:492] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Bootstrap starting.
I20260807 22:50:11.548892 27691 tablet_bootstrap.cc:492] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: Bootstrap starting.
I20260807 22:50:11.548909 27690 tablet_bootstrap.cc:492] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: Bootstrap starting.
I20260807 22:50:11.550022 27689 tablet_bootstrap.cc:654] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:11.551079 27690 tablet_bootstrap.cc:654] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:11.551095 27691 tablet_bootstrap.cc:654] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:11.551465 27689 log.cc:824] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:11.551823 27690 log.cc:824] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:11.552327 27691 log.cc:824] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:11.553830 27690 tablet_bootstrap.cc:492] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: No bootstrap required, opened a new log
I20260807 22:50:11.554033 27691 tablet_bootstrap.cc:492] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: No bootstrap required, opened a new log
I20260807 22:50:11.554061 27690 ts_tablet_manager.cc:1397] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:50:11.554221 27691 ts_tablet_manager.cc:1397] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:50:11.556895 27690 raft_consensus.cc:348] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:11.556885 27691 raft_consensus.cc:348] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:11.557117 27690 raft_consensus.cc:374] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:11.557111 27691 raft_consensus.cc:374] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:11.557183 27691 raft_consensus.cc:729] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0256fb265eb04c929ead8227d87c8e72, State: Initialized, Role: FOLLOWER
I20260807 22:50:11.557204 27690 raft_consensus.cc:729] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3057192b03594be2b48bb855e636656e, State: Initialized, Role: FOLLOWER
I20260807 22:50:11.557638 27691 consensus_queue.cc:260] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:11.557659 27690 consensus_queue.cc:260] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:11.558247 27671 heartbeater.cc:503] Master 127.12.112.254:36567 was elected leader, sending a full tablet report...
I20260807 22:50:11.558485 27528 heartbeater.cc:503] Master 127.12.112.254:36567 was elected leader, sending a full tablet report...
I20260807 22:50:11.558511 27689 tablet_bootstrap.cc:492] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: No bootstrap required, opened a new log
I20260807 22:50:11.558653 27690 ts_tablet_manager.cc:1428] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 22:50:11.558707 27689 ts_tablet_manager.cc:1397] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.003s
I20260807 22:50:11.559672 27691 ts_tablet_manager.cc:1428] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:50:11.562311 27689 raft_consensus.cc:348] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:11.562597 27689 raft_consensus.cc:374] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:11.562700 27689 raft_consensus.cc:729] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73e6030a0a464de29d254f53c321f340, State: Initialized, Role: FOLLOWER
I20260807 22:50:11.563141 27689 consensus_queue.cc:260] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:11.563767 27384 heartbeater.cc:503] Master 127.12.112.254:36567 was elected leader, sending a full tablet report...
I20260807 22:50:11.564042 27689 ts_tablet_manager.cc:1428] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260807 22:50:11.604354 27696 raft_consensus.cc:482] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:50:11.604563 27696 raft_consensus.cc:504] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:11.605662 27696 leader_election.cc:288] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3057192b03594be2b48bb855e636656e (127.12.112.194:32927), 73e6030a0a464de29d254f53c321f340 (127.12.112.193:40613)
I20260807 22:50:11.609833 27673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.605938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40613 (local address 127.12.112.195:34497)
0807 22:50:11.606045 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:11.606061 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:11.606154 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:11.606494 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:11.606498 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:11.606517 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:11.606645 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.606651 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.607525 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.607529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.608620 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.608629 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.609384 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.609388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.609500 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.609527 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:50:11.609617 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:50:11.609690 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260807 22:50:11.609865 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.606025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:34497 (local address 127.12.112.193:40613)
0807 22:50:11.606169 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:11.606174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:11.606192 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:50:11.606257 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:11.606261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:11.606380 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:11.606483 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:11.606763 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.607409 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.608751 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.609266 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.609359 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.609407 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:11.609658 (+ 251us) server_negotiation.cc:299] Negotiation successful
0807 22:50:11.609734 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 22:50:11.610147 27685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.606138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:56669 (local address 127.12.112.194:32927)
0807 22:50:11.606263 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:11.606267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:11.606573 (+ 306us) server_negotiation.cc:407] Connection header received
0807 22:50:11.606716 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:11.606719 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:11.606771 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:11.606875 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:11.607145 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.607836 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.609060 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.609556 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.609664 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.609707 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:11.609915 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 22:50:11.610001 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:50:11.610169 27699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.605938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:32927 (local address 127.12.112.195:56669)
0807 22:50:11.606474 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:11.606486 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:11.606603 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:11.606880 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:11.606883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:11.606900 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:11.607030 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.607036 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.607982 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.607986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.608931 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:11.608941 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.609675 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.609679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:11.609776 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.609799 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:50:11.609887 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:50:11.610031 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":131,"thread_start_us":157,"threads_started":1}
I20260807 22:50:11.610543 27336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66760eef752948f7a716a1683384224a" candidate_uuid: "0256fb265eb04c929ead8227d87c8e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73e6030a0a464de29d254f53c321f340" is_pre_election: true
I20260807 22:50:11.610882 27336 raft_consensus.cc:2454] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0256fb265eb04c929ead8227d87c8e72 in term 0.
I20260807 22:50:11.610893 27479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66760eef752948f7a716a1683384224a" candidate_uuid: "0256fb265eb04c929ead8227d87c8e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3057192b03594be2b48bb855e636656e" is_pre_election: true
I20260807 22:50:11.611168 27479 raft_consensus.cc:2454] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0256fb265eb04c929ead8227d87c8e72 in term 0.
I20260807 22:50:11.611456 27552 leader_election.cc:302] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0256fb265eb04c929ead8227d87c8e72, 73e6030a0a464de29d254f53c321f340; no voters:
I20260807 22:50:11.611758 27696 raft_consensus.cc:2781] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:50:11.611847 27696 raft_consensus.cc:482] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:50:11.611893 27696 raft_consensus.cc:3037] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:11.612927 27696 raft_consensus.cc:504] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:11.613240 27696 leader_election.cc:288] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [CANDIDATE]: Term 1 election: Requested vote from peers 3057192b03594be2b48bb855e636656e (127.12.112.194:32927), 73e6030a0a464de29d254f53c321f340 (127.12.112.193:40613)
I20260807 22:50:11.613560 27479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66760eef752948f7a716a1683384224a" candidate_uuid: "0256fb265eb04c929ead8227d87c8e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3057192b03594be2b48bb855e636656e"
I20260807 22:50:11.613607 27336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66760eef752948f7a716a1683384224a" candidate_uuid: "0256fb265eb04c929ead8227d87c8e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73e6030a0a464de29d254f53c321f340"
I20260807 22:50:11.613689 27479 raft_consensus.cc:3037] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:11.613711 27336 raft_consensus.cc:3037] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:11.614998 27336 raft_consensus.cc:2454] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0256fb265eb04c929ead8227d87c8e72 in term 1.
I20260807 22:50:11.614998 27479 raft_consensus.cc:2454] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0256fb265eb04c929ead8227d87c8e72 in term 1.
I20260807 22:50:11.615280 27553 leader_election.cc:302] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0256fb265eb04c929ead8227d87c8e72, 3057192b03594be2b48bb855e636656e; no voters:
I20260807 22:50:11.615445 27696 raft_consensus.cc:2781] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:50:11.615695 27696 raft_consensus.cc:686] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 1 LEADER]: Becoming Leader. State: Replica: 0256fb265eb04c929ead8227d87c8e72, State: Running, Role: LEADER
I20260807 22:50:11.616014 27696 consensus_queue.cc:237] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:11.619131 27183 catalog_manager.cc:5495] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195). New cstate: current_term: 1 leader_uuid: "0256fb265eb04c929ead8227d87c8e72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } health_report { overall_health: UNKNOWN } } }
I20260807 22:50:11.635213 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.631712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54616 (local address 127.12.112.195:46555)
0807 22:50:11.631847 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:11.631850 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:11.631864 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:50:11.632007 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:11.632009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:11.632059 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:11.632152 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:50:11.632348 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.632852 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.633696 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:11.633913 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:11.634050 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:11.634385 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:50:11.634798 (+ 413us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:50:11.634930 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:11.634993 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 22:50:11.635048 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:50:11.641363 27479 raft_consensus.cc:1261] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e [term 1 FOLLOWER]: Refusing update from remote peer 0256fb265eb04c929ead8227d87c8e72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:11.641381 27336 raft_consensus.cc:1261] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Refusing update from remote peer 0256fb265eb04c929ead8227d87c8e72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:11.642066 27700 consensus_queue.cc:1035] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:11.642338 27696 consensus_queue.cc:1035] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:11.651957 27705 mvcc.cc:205] Tried to move back new op lower bound from 7316041775675281408 to 7316041775582121984. Current Snapshot: MvccSnapshot[applied={T|T < 7316041775675281408 or (T in {7316041775675281408})}]
I20260807 22:50:11.658696 27184 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:50:11.658898 27184 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:50:11.661337 27184 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Sending DeleteTablet for 3 replicas of tablet 66760eef752948f7a716a1683384224a
I20260807 22:50:11.662084 27600 tablet_service.cc:1514] Processing DeleteTablet for tablet 66760eef752948f7a716a1683384224a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:11 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:54608
I20260807 22:50:11.662087 27459 tablet_service.cc:1514] Processing DeleteTablet for tablet 66760eef752948f7a716a1683384224a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:11 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:35204
I20260807 22:50:11.662161 27314 tablet_service.cc:1514] Processing DeleteTablet for tablet 66760eef752948f7a716a1683384224a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:11 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:41084
I20260807 22:50:11.662709 27715 tablet_replica.cc:330] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: stopping tablet replica
I20260807 22:50:11.662825 27714 tablet_replica.cc:330] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: stopping tablet replica
I20260807 22:50:11.663072 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 27248
I20260807 22:50:11.663077 27715 raft_consensus.cc:2229] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:50:11.664425 27714 raft_consensus.cc:2229] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:50:11.664860 27713 tablet_replica.cc:330] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: stopping tablet replica
I20260807 22:50:11.665114 27713 raft_consensus.cc:2229] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:50:11.665439 27713 raft_consensus.cc:2258] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:11.667165 27713 ts_tablet_manager.cc:1905] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:11.669986 27713 ts_tablet_manager.cc:1918] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:11.670076 27713 log.cc:1196] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/66760eef752948f7a716a1683384224a
I20260807 22:50:11.670451 27713 ts_tablet_manager.cc:1939] T 66760eef752948f7a716a1683384224a P 3057192b03594be2b48bb855e636656e: Deleting consensus metadata
I20260807 22:50:11.671715 27168 catalog_manager.cc:4841] TS 3057192b03594be2b48bb855e636656e (127.12.112.194:32927): tablet 66760eef752948f7a716a1683384224a (table test-table [id=5597059d5e384d55b4ee653f76041f4d]) successfully deleted
I20260807 22:50:11.674504 27714 raft_consensus.cc:2258] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:11.675971 27714 ts_tablet_manager.cc:1905] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:11.678164 27714 ts_tablet_manager.cc:1918] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:11.678277 27714 log.cc:1196] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/66760eef752948f7a716a1683384224a
W20260807 22:50:11.678479 27167 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:40613 (error 108)
I20260807 22:50:11.678683 27714 ts_tablet_manager.cc:1939] T 66760eef752948f7a716a1683384224a P 0256fb265eb04c929ead8227d87c8e72: Deleting consensus metadata
I20260807 22:50:11.678839 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 27389
I20260807 22:50:11.680919 27683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:11.680180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40613 (local address 127.0.0.1:41088)
0807 22:50:11.680701 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:11.680786 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:40613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409}
I20260807 22:50:11.681102 27169 catalog_manager.cc:4841] TS 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555): tablet 66760eef752948f7a716a1683384224a (table test-table [id=5597059d5e384d55b4ee653f76041f4d]) successfully deleted
W20260807 22:50:11.681864 27167 catalog_manager.cc:4584] TS 73e6030a0a464de29d254f53c321f340 (127.12.112.193:40613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 66760eef752948f7a716a1683384224a: Network error: Client connection negotiation failed: client connection to 127.12.112.193:40613: connect: Connection refused (error 111)
I20260807 22:50:11.687376 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 27535
I20260807 22:50:11.694147 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 27148
I20260807 22:50:11.701298 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36567
--webserver_interface=127.12.112.254
--webserver_port=33037
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:36567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:11.814281 27717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:11.814577 27717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:11.814617 27717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:11.818660 27717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:50:11.818718 27717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:11.818737 27717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:11.818761 27717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:50:11.818778 27717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:50:11.824414 27717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:36567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=33037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:11.825536 27717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:11.826644 27717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:11.840605 27724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:11.840803 27717 server_base.cc:1034] running on GCE node
W20260807 22:50:11.840605 27723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:11.840608 27727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:11.841655 27717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:11.842947 27717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:11.844175 27717 hybrid_clock.cc:648] HybridClock initialized: now 1786143011844144 us; error 59 us; skew 500 ppm
Aug 07 22:50:11 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143011, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:11.847110 27717 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:50:11.848125 27717 webserver.cc:460] Webserver started at http://127.12.112.254:33037/ using document root <none> and password file <none>
I20260807 22:50:11.848719 27717 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:11.848843 27717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:11.853006 27717 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:50:11.855257 27736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:11.856559 27717 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260807 22:50:11.856707 27717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "6d140683bfb140b19f644a141ee12617"
format_stamp: "Formatted at 2026-08-07 22:50:10 on dist-test-slave-tm1g"
server_key: "917c731702fcf04be115745d3115a852"
server_key_iv: "7390b8ba7f044c54ab46805bdfca95b8"
server_key_version: "encryptionkey@0"
I20260807 22:50:11.857355 27717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:11.870389 27717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:11.873303 27717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:11.873457 27717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:11.880569 27717 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:36567
I20260807 22:50:11.880892 27793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:36567 every 8 connection(s)
I20260807 22:50:11.881688 27717 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:50:11.885955 27794 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:50:11.887709 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 27717
I20260807 22:50:11.887797 27794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Bootstrap starting.
I20260807 22:50:11.888230 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:40613
--local_ip_for_outbound_sockets=127.12.112.193
--tserver_master_addrs=127.12.112.254:36567
--webserver_port=46133
--webserver_interface=127.12.112.193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:50:11.905655 27794 log.cc:824] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:11.916193 27794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:50:11.916604 27794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Bootstrap complete.
I20260807 22:50:11.920816 27794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:11.921218 27794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d140683bfb140b19f644a141ee12617, State: Initialized, Role: FOLLOWER
I20260807 22:50:11.921759 27794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:11.921880 27794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:50:11.921974 27794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:50:11.922086 27794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:50:11.924114 27794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:11.924468 27794 leader_election.cc:302] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d140683bfb140b19f644a141ee12617; no voters:
I20260807 22:50:11.924803 27794 leader_election.cc:288] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:50:11.924896 27798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:50:11.925098 27798 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 2 LEADER]: Becoming Leader. State: Replica: 6d140683bfb140b19f644a141ee12617, State: Running, Role: LEADER
I20260807 22:50:11.925784 27798 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:11.926077 27794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:50:11.927296 27800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6d140683bfb140b19f644a141ee12617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } } }
I20260807 22:50:11.927359 27801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d140683bfb140b19f644a141ee12617. Latest consensus state: current_term: 2 leader_uuid: "6d140683bfb140b19f644a141ee12617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } } }
I20260807 22:50:11.927477 27801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:11.927428 27800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:11.927934 27808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:50:11.932641 27808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:50:11.933317 27808 catalog_manager.cc:1259] Loaded cluster ID: 18110d1f0d4a47e1bf331c9eab51daeb
I20260807 22:50:11.933379 27808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:50:11.934859 27808 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 22:50:11.939774 27808 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 22:50:11.945225 27808 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:50:11.945979 27808 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Loaded TSK: 0
I20260807 22:50:11.947175 27808 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:50:12.005000 27796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:12.005290 27796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:12.005394 27796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:12.009593 27796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:12.009670 27796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:12.009752 27796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:50:12.015004 27796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:40613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=46133
--tserver_master_addrs=127.12.112.254:36567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:12.016001 27796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:12.017011 27796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:12.027305 27823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:12.027308 27825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:12.027592 27827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:12.028086 27796 server_base.cc:1034] running on GCE node
I20260807 22:50:12.028503 27796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:12.029126 27796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:12.030370 27796 hybrid_clock.cc:648] HybridClock initialized: now 1786143012030347 us; error 35 us; skew 500 ppm
Aug 07 22:50:12 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143012, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:12.033157 27796 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:50:12.033973 27796 webserver.cc:460] Webserver started at http://127.12.112.193:46133/ using document root <none> and password file <none>
I20260807 22:50:12.034592 27796 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:12.034703 27796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:12.038578 27796 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:50:12.040735 27834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:12.042034 27796 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:12.042171 27796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "73e6030a0a464de29d254f53c321f340"
format_stamp: "Formatted at 2026-08-07 22:50:10 on dist-test-slave-tm1g"
server_key: "063289d925db46f7f47af07548794626"
server_key_iv: "22d7cf06c0bb95efca9dced9da055703"
server_key_version: "encryptionkey@0"
I20260807 22:50:12.042778 27796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:12.052093 27796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:12.055166 27796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:12.055359 27796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:12.055927 27796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:12.056963 27842 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:50:12.062122 27796 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:50:12.062196 27796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260807 22:50:12.062278 27796 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:50:12.063912 27796 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:50:12.063980 27796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 22:50:12.064293 27842 tablet_bootstrap.cc:492] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Bootstrap starting.
I20260807 22:50:12.075184 27796 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:40613
I20260807 22:50:12.075428 27959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:40613 every 8 connection(s)
I20260807 22:50:12.076256 27796 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:50:12.085530 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 27796
I20260807 22:50:12.085582 27842 log.cc:824] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:12.086047 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:32927
--local_ip_for_outbound_sockets=127.12.112.194
--tserver_master_addrs=127.12.112.254:36567
--webserver_port=44767
--webserver_interface=127.12.112.194
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:50:12 dist-test-slave-tm1g krb5kdc[27134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143012, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:12.093811 27842 tablet_bootstrap.cc:492] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:50:12.094280 27842 tablet_bootstrap.cc:492] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Bootstrap complete.
I20260807 22:50:12.095649 27842 ts_tablet_manager.cc:1397] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Time spent bootstrapping tablet: real 0.032s user 0.021s sys 0.009s
I20260807 22:50:12.096804 27964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.078511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:51779)
0807 22:50:12.079459 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:12.079518 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:12.080742 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:12.082051 (+ 1309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:12.082067 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:12.082600 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:12.083286 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.083310 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.085059 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.085065 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.086486 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.086500 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.087750 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.087754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.087932 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.088597 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:12.088617 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:12.090422 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:12.093231 (+ 2809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:12.093237 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:12.093248 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:12.093592 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:12.094059 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:12.094065 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:12.094070 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:12.094250 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:12.095064 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:12.095072 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:12.095365 (+ 293us) client_negotiation.cc:769] Sending connection context
0807 22:50:12.095566 (+ 201us) client_negotiation.cc:240] Negotiation successful
0807 22:50:12.095887 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"thread_start_us":132,"threads_started":1}
I20260807 22:50:12.097409 27963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.078537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:51779 (local address 127.12.112.254:36567)
0807 22:50:12.079088 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.079114 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.079663 (+ 549us) server_negotiation.cc:407] Connection header received
0807 22:50:12.081199 (+ 1536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.081212 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.081576 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.081914 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:12.083511 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.084878 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.086641 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.087356 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.087516 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.090652 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:12.090660 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:12.090680 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:12.090720 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:12.093093 (+ 2373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:12.093745 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:12.093754 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:12.093762 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:12.093938 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:12.094401 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:12.094407 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:12.094412 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:12.094929 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:12.095083 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.095756 (+ 673us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.096095 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":129,"threads_started":1}
I20260807 22:50:12.098567 27842 raft_consensus.cc:348] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.099086 27842 raft_consensus.cc:729] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73e6030a0a464de29d254f53c321f340, State: Initialized, Role: FOLLOWER
I20260807 22:50:12.099611 27842 consensus_queue.cc:260] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.099781 27960 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36567
I20260807 22:50:12.100021 27960 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:12.100530 27842 ts_tablet_manager.cc:1428] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:50:12.100555 27960 heartbeater.cc:511] Master 127.12.112.254:36567 requested a full tablet report, sending...
I20260807 22:50:12.102947 27755 ts_manager.cc:194] Registered new tserver with Master: 73e6030a0a464de29d254f53c321f340 (127.12.112.193:40613)
I20260807 22:50:12.106137 27755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:51779
I20260807 22:50:12.108834 27960 heartbeater.cc:503] Master 127.12.112.254:36567 was elected leader, sending a full tablet report...
Aug 07 22:50:12 dist-test-slave-tm1g krb5kdc[27134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143011, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:50:12.116070 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.105604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40613 (local address 127.0.0.1:41096)
0807 22:50:12.106267 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:12.106334 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:12.106466 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:12.106956 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:12.106961 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:12.107401 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:12.107504 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.107510 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.108512 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.108516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.109336 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.109368 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.110203 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.110207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.110380 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.110967 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:12.110979 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:12.112484 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:12.114242 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:12.114253 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:12.114258 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:12.114559 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:12.114869 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:12.114873 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:12.114875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:12.114969 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:12.115428 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:12.115434 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:12.115561 (+ 127us) client_negotiation.cc:769] Sending connection context
0807 22:50:12.115693 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 22:50:12.115892 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":110,"threads_started":1}
I20260807 22:50:12.116082 27969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.105672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41096 (local address 127.12.112.193:40613)
0807 22:50:12.106025 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.106036 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.106434 (+ 398us) server_negotiation.cc:407] Connection header received
0807 22:50:12.106614 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.106619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.106811 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.106942 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:12.107629 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.108400 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.109509 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.110086 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.110190 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.112618 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:12.112627 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:12.112639 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:12.112671 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:12.114127 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:12.114678 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:12.114684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:12.114686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:12.114774 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:12.115068 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:12.115071 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:12.115073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:12.115302 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:12.115455 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.115787 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.115944 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":91,"threads_started":1}
I20260807 22:50:12.117015 27889 tablet_service.cc:1514] Processing DeleteTablet for tablet 66760eef752948f7a716a1683384224a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:11 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:41096
I20260807 22:50:12.117837 27970 tablet_replica.cc:330] stopping tablet replica
I20260807 22:50:12.118145 27970 raft_consensus.cc:2229] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:50:12.118427 27970 raft_consensus.cc:2258] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:12.119347 27970 ts_tablet_manager.cc:1905] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:12.122819 27970 ts_tablet_manager.cc:1918] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:12.122908 27970 log.cc:1196] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/66760eef752948f7a716a1683384224a
I20260807 22:50:12.123212 27970 ts_tablet_manager.cc:1939] T 66760eef752948f7a716a1683384224a P 73e6030a0a464de29d254f53c321f340: Deleting consensus metadata
I20260807 22:50:12.124871 27738 catalog_manager.cc:4841] TS 73e6030a0a464de29d254f53c321f340 (127.12.112.193:40613): tablet 66760eef752948f7a716a1683384224a (table test-table [id=5597059d5e384d55b4ee653f76041f4d]) successfully deleted
W20260807 22:50:12.205216 27966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:12.205479 27966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:12.205520 27966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:12.209549 27966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:12.209602 27966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:12.209658 27966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:50:12.214749 27966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:32927
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=44767
--tserver_master_addrs=127.12.112.254:36567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:12.215672 27966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:12.216627 27966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:12.226099 27976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:12.226099 27979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:12.226136 27977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:12.226167 27966 server_base.cc:1034] running on GCE node
I20260807 22:50:12.226850 27966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:12.227530 27966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:12.228711 27966 hybrid_clock.cc:648] HybridClock initialized: now 1786143012228700 us; error 25 us; skew 500 ppm
Aug 07 22:50:12 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143012, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:12.231441 27966 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:50:12.232259 27966 webserver.cc:460] Webserver started at http://127.12.112.194:44767/ using document root <none> and password file <none>
I20260807 22:50:12.232754 27966 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:12.232833 27966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:12.236517 27966 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:50:12.238552 27987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:12.239719 27966 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:12.239822 27966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "3057192b03594be2b48bb855e636656e"
format_stamp: "Formatted at 2026-08-07 22:50:11 on dist-test-slave-tm1g"
server_key: "5a8fd9056aee464e17d0accfe80a6e8f"
server_key_iv: "dca51e0c03c5f67c871a06f68fe634f1"
server_key_version: "encryptionkey@0"
I20260807 22:50:12.240315 27966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:12.259440 27966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:12.262871 27966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:12.263027 27966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:12.263562 27966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:12.264390 27966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:12.264438 27966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:12.264480 27966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:12.264501 27966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:12.273319 27966 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:32927
I20260807 22:50:12.273367 28110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:32927 every 8 connection(s)
I20260807 22:50:12.274277 27966 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:50:12.274680 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 27966
I20260807 22:50:12.275197 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:46555
--local_ip_for_outbound_sockets=127.12.112.195
--tserver_master_addrs=127.12.112.254:36567
--webserver_port=42891
--webserver_interface=127.12.112.195
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:50:12 dist-test-slave-tm1g krb5kdc[27134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143012, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:12.291082 27963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.276284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:55117 (local address 127.12.112.254:36567)
0807 22:50:12.276451 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.276455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.277577 (+ 1122us) server_negotiation.cc:407] Connection header received
0807 22:50:12.279605 (+ 2028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.279609 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.279659 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.279735 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:12.281436 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.281955 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.283908 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.284154 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.284249 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.287297 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:12.287299 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:12.287302 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:12.287346 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:12.288904 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:12.289423 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:12.289426 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:12.289428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:12.289527 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:12.289883 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:12.289886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:12.289888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:12.290069 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:12.290178 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.290773 (+ 595us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.290906 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 22:50:12.291877 28114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.276772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:55117)
0807 22:50:12.277387 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:12.277448 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:12.279367 (+ 1919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:12.279961 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:12.279975 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:12.280515 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:12.281248 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.281271 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.282106 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.282113 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.283765 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.283781 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.284327 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.284334 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.284577 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.285243 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:12.285286 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:12.287083 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:12.289024 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:12.289030 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:12.289043 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:12.289296 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:12.289631 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:12.289634 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:12.289635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:12.289776 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:12.290177 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:12.290183 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:12.290530 (+ 347us) client_negotiation.cc:769] Sending connection context
0807 22:50:12.290712 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 22:50:12.291051 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":165,"threads_started":1}
I20260807 22:50:12.293061 28111 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36567
I20260807 22:50:12.293318 28111 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:12.293924 28111 heartbeater.cc:511] Master 127.12.112.254:36567 requested a full tablet report, sending...
I20260807 22:50:12.295034 27755 ts_manager.cc:194] Registered new tserver with Master: 3057192b03594be2b48bb855e636656e (127.12.112.194:32927)
I20260807 22:50:12.295771 27755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:55117
W20260807 22:50:12.391896 28113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:12.392143 28113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:12.392184 28113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:12.396153 28113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:12.396205 28113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:12.396262 28113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:50:12.401351 28113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:46555
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=42891
--tserver_master_addrs=127.12.112.254:36567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:12.402282 28113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:12.403302 28113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:12.412817 28122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:12.412885 28120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:12.412926 28113 server_base.cc:1034] running on GCE node
W20260807 22:50:12.412885 28119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:12.413539 28113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:12.414139 28113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:12.415324 28113 hybrid_clock.cc:648] HybridClock initialized: now 1786143012415312 us; error 34 us; skew 500 ppm
Aug 07 22:50:12 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143012, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:12.417932 28113 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:50:12.418820 28113 webserver.cc:460] Webserver started at http://127.12.112.195:42891/ using document root <none> and password file <none>
I20260807 22:50:12.419381 28113 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:12.419493 28113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:12.423375 28113 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:50:12.425500 28130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:12.426791 28113 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:50:12.426956 28113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "0256fb265eb04c929ead8227d87c8e72"
format_stamp: "Formatted at 2026-08-07 22:50:11 on dist-test-slave-tm1g"
server_key: "9d3b8520e54ea65b40337ab9dcdff32c"
server_key_iv: "91c3419bce6c6d6abf1b97e70aa1de87"
server_key_version: "encryptionkey@0"
I20260807 22:50:12.427618 28113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:12.448431 28113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:12.451798 28113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:12.452047 28113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:12.452636 28113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:12.453460 28113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:12.453505 28113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:12.453568 28113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:12.453599 28113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:12.462165 28113 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:46555
I20260807 22:50:12.462218 28251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:46555 every 8 connection(s)
I20260807 22:50:12.463200 28113 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:50:12 dist-test-slave-tm1g krb5kdc[27134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143012, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:12.473302 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 28113
I20260807 22:50:12.477043 27963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.465029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:45707 (local address 127.12.112.254:36567)
0807 22:50:12.465174 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.465177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.466035 (+ 858us) server_negotiation.cc:407] Connection header received
0807 22:50:12.467489 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.467493 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.467552 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.467655 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:12.468786 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.469325 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.470516 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.470747 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.470859 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.473309 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:12.473314 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:12.473316 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:12.473340 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:12.474974 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:12.475572 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:12.475575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:12.475577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:12.475667 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:12.475981 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:12.475984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:12.475986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:12.476182 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:12.476274 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.476834 (+ 560us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.476927 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:50:12.478084 28254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.465435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:45707)
0807 22:50:12.465878 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:12.465929 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:12.467270 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:12.467828 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:12.467834 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:12.468189 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:12.468637 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.468649 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.469451 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.469456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.470394 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.470403 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.470895 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.470900 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.471074 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.471639 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:12.471654 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:12.473127 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:12.475088 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:12.475095 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:12.475112 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:12.475473 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:12.475756 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:12.475758 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:12.475760 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:12.475887 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:12.476276 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:12.476280 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:12.476581 (+ 301us) client_negotiation.cc:769] Sending connection context
0807 22:50:12.476786 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 22:50:12.477093 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":112,"threads_started":1}
I20260807 22:50:12.479272 28252 heartbeater.cc:347] Connected to a master server at 127.12.112.254:36567
I20260807 22:50:12.479525 28252 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:12.480003 28252 heartbeater.cc:511] Master 127.12.112.254:36567 requested a full tablet report, sending...
I20260807 22:50:12.481017 27755 ts_manager.cc:194] Registered new tserver with Master: 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555)
I20260807 22:50:12.481590 27755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:45707
I20260807 22:50:12.482709 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.474008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35900 (local address 127.12.112.254:36567)
0807 22:50:12.474291 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.474295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.474424 (+ 129us) server_negotiation.cc:407] Connection header received
0807 22:50:12.474578 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.474581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.474628 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.474714 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:12.475572 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.476282 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.477428 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.477648 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.477728 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.479351 (+ 1623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:12.479355 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:12.479357 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:12.479395 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:12.480860 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:12.481345 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:12.481350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:12.481352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:12.481433 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:12.481762 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:12.481765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:12.481767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:12.481976 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:12.482186 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.482432 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.482530 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":98,"threads_started":1}
I20260807 22:50:12.484413 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:50:12.488188 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.484969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35902 (local address 127.12.112.254:36567)
0807 22:50:12.485081 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.485085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.485273 (+ 188us) server_negotiation.cc:407] Connection header received
0807 22:50:12.485375 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.485377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.485453 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.485531 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:50:12.485730 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.486189 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.487004 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.487216 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.487294 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.487574 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:50:12.487912 (+ 338us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:50:12.488005 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.488061 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.488105 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:50:12.488768 27755 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:35902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:50:12.492065 27755 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:50:12.499794 27889 tablet_service.cc:1467] Processing CreateTablet for tablet f0832e81e01042dcb60ce1929d35b8d1 (DEFAULT_TABLE table=test-table [id=f82d1f276fb34a6d97965de0eb2e7b8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:12.500479 27889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0832e81e01042dcb60ce1929d35b8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:12.503463 27842 tablet_bootstrap.cc:492] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Bootstrap starting.
I20260807 22:50:12.504124 28261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.498910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:46555 (local address 127.0.0.1:54628)
0807 22:50:12.499420 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:12.499434 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:12.499519 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:12.500204 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:12.500209 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:12.500231 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:12.500310 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.500315 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.501832 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.501837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.502696 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.502705 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.503734 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.503757 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.503858 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.503894 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 22:50:12.503940 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 22:50:12.503992 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"mutex_wait_us":4,"thread_start_us":88,"threads_started":1}
I20260807 22:50:12.504362 27842 tablet_bootstrap.cc:654] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:12.504550 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.498660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:32927 (local address 127.0.0.1:35212)
0807 22:50:12.498791 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:12.498806 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:12.498885 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:12.499806 (+ 921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:12.499809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:12.499826 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:12.499931 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.499937 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.501462 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.501465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.502729 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.502740 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.504165 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.504168 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.504271 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.504293 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:50:12.504367 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:50:12.504437 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":82}
I20260807 22:50:12.504681 28264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.498833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35212 (local address 127.12.112.194:32927)
0807 22:50:12.499298 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.499312 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.499335 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:50:12.499414 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.499420 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.499644 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.499830 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:12.500027 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.501316 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.502894 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.504036 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.504164 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.504297 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.504400 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.504502 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":153,"threads_started":1}
I20260807 22:50:12.504719 28265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.499378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54628 (local address 127.12.112.195:46555)
0807 22:50:12.499763 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.499779 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.499802 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:50:12.499875 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.499892 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.500065 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.500217 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:12.500450 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.501705 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.502818 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.503592 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.504293 (+ 701us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.504434 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.504482 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.504567 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":103,"threads_started":1}
I20260807 22:50:12.506001 27842 tablet_bootstrap.cc:492] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: No bootstrap required, opened a new log
I20260807 22:50:12.506093 27842 ts_tablet_manager.cc:1397] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 22:50:12.506557 27842 raft_consensus.cc:348] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.506687 27842 raft_consensus.cc:374] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:12.506726 27842 raft_consensus.cc:729] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73e6030a0a464de29d254f53c321f340, State: Initialized, Role: FOLLOWER
I20260807 22:50:12.506850 27842 consensus_queue.cc:260] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.507232 27842 ts_tablet_manager.cc:1428] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:50:12.507849 28041 tablet_service.cc:1467] Processing CreateTablet for tablet f0832e81e01042dcb60ce1929d35b8d1 (DEFAULT_TABLE table=test-table [id=f82d1f276fb34a6d97965de0eb2e7b8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:12.508906 28041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0832e81e01042dcb60ce1929d35b8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:12.512313 28182 tablet_service.cc:1467] Processing CreateTablet for tablet f0832e81e01042dcb60ce1929d35b8d1 (DEFAULT_TABLE table=test-table [id=f82d1f276fb34a6d97965de0eb2e7b8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:12.513358 28182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0832e81e01042dcb60ce1929d35b8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:12.516706 28267 tablet_bootstrap.cc:492] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: Bootstrap starting.
I20260807 22:50:12.519106 28267 tablet_bootstrap.cc:654] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:12.519842 28267 log.cc:824] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:12.520440 28269 tablet_bootstrap.cc:492] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: Bootstrap starting.
I20260807 22:50:12.522014 28267 tablet_bootstrap.cc:492] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: No bootstrap required, opened a new log
I20260807 22:50:12.522210 28267 ts_tablet_manager.cc:1397] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:50:12.523306 28269 tablet_bootstrap.cc:654] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:12.524134 28269 log.cc:824] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:12.526154 28269 tablet_bootstrap.cc:492] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: No bootstrap required, opened a new log
I20260807 22:50:12.526191 28267 raft_consensus.cc:348] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.526396 28269 ts_tablet_manager.cc:1397] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:50:12.526485 28267 raft_consensus.cc:374] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:12.526543 28267 raft_consensus.cc:729] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3057192b03594be2b48bb855e636656e, State: Initialized, Role: FOLLOWER
I20260807 22:50:12.527006 28267 consensus_queue.cc:260] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.527781 28111 heartbeater.cc:503] Master 127.12.112.254:36567 was elected leader, sending a full tablet report...
I20260807 22:50:12.528020 28267 ts_tablet_manager.cc:1428] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:50:12.529809 28269 raft_consensus.cc:348] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.530027 28269 raft_consensus.cc:374] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:12.530104 28269 raft_consensus.cc:729] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0256fb265eb04c929ead8227d87c8e72, State: Initialized, Role: FOLLOWER
I20260807 22:50:12.530562 28269 consensus_queue.cc:260] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.531209 28252 heartbeater.cc:503] Master 127.12.112.254:36567 was elected leader, sending a full tablet report...
I20260807 22:50:12.531570 28269 ts_tablet_manager.cc:1428] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
W20260807 22:50:12.577704 27962 tablet.cc:2369] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:50:12.589520 28273 raft_consensus.cc:482] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:50:12.589711 28273 raft_consensus.cc:504] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.590916 28273 leader_election.cc:288] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3057192b03594be2b48bb855e636656e (127.12.112.194:32927), 73e6030a0a464de29d254f53c321f340 (127.12.112.193:40613)
I20260807 22:50:12.595389 27969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.591260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:42447 (local address 127.12.112.193:40613)
0807 22:50:12.591383 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.591389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.591406 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:50:12.591534 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.591537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.591592 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.591703 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:12.592030 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.592852 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.594231 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.594820 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.594921 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.595030 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.595181 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.595251 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:50:12.595397 28254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.591151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40613 (local address 127.12.112.195:42447)
0807 22:50:12.591304 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:12.591322 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:12.591419 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:12.591718 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:12.591721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:12.591740 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:12.591865 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.591871 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.592994 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.592996 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.594112 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.594121 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.594939 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.594942 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.595053 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.595079 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:50:12.595157 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:50:12.595226 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":1}
I20260807 22:50:12.595659 28274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.591157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:32927 (local address 127.12.112.195:45953)
0807 22:50:12.591863 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:12.591875 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:12.591977 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:12.592224 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:12.592226 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:12.592239 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:12.592345 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.592349 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.593283 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.593286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.594460 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:12.594471 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.595200 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.595203 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:12.595299 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.595321 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:50:12.595405 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 22:50:12.595483 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"mutex_wait_us":349,"thread_start_us":150,"threads_started":1}
I20260807 22:50:12.595681 28264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.591270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:45953 (local address 127.12.112.194:32927)
0807 22:50:12.591419 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.591425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.591958 (+ 533us) server_negotiation.cc:407] Connection header received
0807 22:50:12.592075 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.592080 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.592133 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.592206 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:12.592456 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.593149 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.594584 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.595073 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.595192 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.595238 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.595453 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.595541 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:50:12.596029 27913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0832e81e01042dcb60ce1929d35b8d1" candidate_uuid: "0256fb265eb04c929ead8227d87c8e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73e6030a0a464de29d254f53c321f340" is_pre_election: true
I20260807 22:50:12.596351 27913 raft_consensus.cc:2454] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0256fb265eb04c929ead8227d87c8e72 in term 0.
I20260807 22:50:12.596406 28063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0832e81e01042dcb60ce1929d35b8d1" candidate_uuid: "0256fb265eb04c929ead8227d87c8e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3057192b03594be2b48bb855e636656e" is_pre_election: true
I20260807 22:50:12.596666 28063 raft_consensus.cc:2454] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0256fb265eb04c929ead8227d87c8e72 in term 0.
I20260807 22:50:12.596853 28132 leader_election.cc:302] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0256fb265eb04c929ead8227d87c8e72, 73e6030a0a464de29d254f53c321f340; no voters:
I20260807 22:50:12.597167 28273 raft_consensus.cc:2781] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:50:12.597271 28273 raft_consensus.cc:482] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:50:12.597352 28273 raft_consensus.cc:3037] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:12.598465 28273 raft_consensus.cc:504] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.598811 28273 leader_election.cc:288] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [CANDIDATE]: Term 1 election: Requested vote from peers 3057192b03594be2b48bb855e636656e (127.12.112.194:32927), 73e6030a0a464de29d254f53c321f340 (127.12.112.193:40613)
I20260807 22:50:12.599160 28063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0832e81e01042dcb60ce1929d35b8d1" candidate_uuid: "0256fb265eb04c929ead8227d87c8e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3057192b03594be2b48bb855e636656e"
I20260807 22:50:12.599144 27913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0832e81e01042dcb60ce1929d35b8d1" candidate_uuid: "0256fb265eb04c929ead8227d87c8e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73e6030a0a464de29d254f53c321f340"
I20260807 22:50:12.599285 27913 raft_consensus.cc:3037] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:12.599301 28063 raft_consensus.cc:3037] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:12.600276 27913 raft_consensus.cc:2454] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0256fb265eb04c929ead8227d87c8e72 in term 1.
I20260807 22:50:12.600416 28063 raft_consensus.cc:2454] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0256fb265eb04c929ead8227d87c8e72 in term 1.
I20260807 22:50:12.600543 28132 leader_election.cc:302] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0256fb265eb04c929ead8227d87c8e72, 73e6030a0a464de29d254f53c321f340; no voters:
I20260807 22:50:12.600733 28273 raft_consensus.cc:2781] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:50:12.600972 28273 raft_consensus.cc:686] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 1 LEADER]: Becoming Leader. State: Replica: 0256fb265eb04c929ead8227d87c8e72, State: Running, Role: LEADER
I20260807 22:50:12.601305 28273 consensus_queue.cc:237] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:12.604355 27755 catalog_manager.cc:5495] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195). New cstate: current_term: 1 leader_uuid: "0256fb265eb04c929ead8227d87c8e72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } health_report { overall_health: UNKNOWN } } }
I20260807 22:50:12.625703 28265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.622185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54644 (local address 127.12.112.195:46555)
0807 22:50:12.622362 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:12.622368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:12.622386 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:50:12.622475 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:12.622480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:12.622563 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:12.622685 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:50:12.623028 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.623527 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.624333 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:12.624540 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:12.624614 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:12.624927 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:50:12.625317 (+ 390us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:50:12.625400 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:12.625480 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 22:50:12.625528 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:50:12.631459 27913 raft_consensus.cc:1261] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Refusing update from remote peer 0256fb265eb04c929ead8227d87c8e72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:12.631462 28063 raft_consensus.cc:1261] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e [term 1 FOLLOWER]: Refusing update from remote peer 0256fb265eb04c929ead8227d87c8e72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:12.632124 28276 consensus_queue.cc:1035] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:12.632290 28273 consensus_queue.cc:1035] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:12.640039 28280 mvcc.cc:205] Tried to move back new op lower bound from 7316041779730808832 to 7316041779617746944. Current Snapshot: MvccSnapshot[applied={T|T < 7316041779730808832}]
I20260807 22:50:12.648810 27755 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:35902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:50:12.648957 27755 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:35902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:50:12.651224 27755 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Sending DeleteTablet for 3 replicas of tablet f0832e81e01042dcb60ce1929d35b8d1
I20260807 22:50:12.651913 28041 tablet_service.cc:1514] Processing DeleteTablet for tablet f0832e81e01042dcb60ce1929d35b8d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:12 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:35212
I20260807 22:50:12.651911 28182 tablet_service.cc:1514] Processing DeleteTablet for tablet f0832e81e01042dcb60ce1929d35b8d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:12 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:54628
I20260807 22:50:12.652012 27889 tablet_service.cc:1514] Processing DeleteTablet for tablet f0832e81e01042dcb60ce1929d35b8d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:12 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:41096
I20260807 22:50:12.652400 28291 tablet_replica.cc:330] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: stopping tablet replica
I20260807 22:50:12.652397 28289 tablet_replica.cc:330] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: stopping tablet replica
I20260807 22:50:12.652607 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 27796
I20260807 22:50:12.652593 28291 raft_consensus.cc:2229] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:50:12.652690 28289 raft_consensus.cc:2229] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:50:12.652748 28291 raft_consensus.cc:2258] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:12.653009 28289 raft_consensus.cc:2258] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:12.653292 28290 tablet_replica.cc:330] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: stopping tablet replica
I20260807 22:50:12.653532 28290 raft_consensus.cc:2229] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:50:12.653751 28290 raft_consensus.cc:2258] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:12.655287 28290 ts_tablet_manager.cc:1905] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:12.658365 28290 ts_tablet_manager.cc:1918] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:12.658478 28290 log.cc:1196] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/f0832e81e01042dcb60ce1929d35b8d1
I20260807 22:50:12.658968 28290 ts_tablet_manager.cc:1939] T f0832e81e01042dcb60ce1929d35b8d1 P 3057192b03594be2b48bb855e636656e: Deleting consensus metadata
I20260807 22:50:12.660204 27739 catalog_manager.cc:4841] TS 3057192b03594be2b48bb855e636656e (127.12.112.194:32927): tablet f0832e81e01042dcb60ce1929d35b8d1 (table test-table [id=f82d1f276fb34a6d97965de0eb2e7b8c]) successfully deleted
I20260807 22:50:12.661657 28289 ts_tablet_manager.cc:1905] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:12.663851 28289 ts_tablet_manager.cc:1918] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:12.663985 28289 log.cc:1196] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/f0832e81e01042dcb60ce1929d35b8d1
I20260807 22:50:12.664295 28289 ts_tablet_manager.cc:1939] T f0832e81e01042dcb60ce1929d35b8d1 P 0256fb265eb04c929ead8227d87c8e72: Deleting consensus metadata
I20260807 22:50:12.665275 27740 catalog_manager.cc:4841] TS 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555): tablet f0832e81e01042dcb60ce1929d35b8d1 (table test-table [id=f82d1f276fb34a6d97965de0eb2e7b8c]) successfully deleted
W20260807 22:50:12.667438 27738 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:40613 (error 108)
I20260807 22:50:12.667681 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 27966
I20260807 22:50:12.668612 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:12.668251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40613 (local address 127.0.0.1:41110)
0807 22:50:12.668421 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:12.668511 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:40613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 22:50:12.668777 27738 catalog_manager.cc:4584] TS 73e6030a0a464de29d254f53c321f340 (127.12.112.193:40613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f0832e81e01042dcb60ce1929d35b8d1: Network error: Client connection negotiation failed: client connection to 127.12.112.193:40613: connect: Connection refused (error 111)
I20260807 22:50:12.675206 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 28113
I20260807 22:50:12.681809 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 27717
I20260807 22:50:12.689050 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36567
--webserver_interface=127.12.112.254
--webserver_port=33037
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:36567
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:12.799656 28293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:12.799896 28293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:12.799935 28293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:12.803871 28293 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:50:12.803921 28293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:12.803941 28293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:12.803956 28293 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:50:12.803972 28293 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:50:12.809180 28293 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:36567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:36567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=33037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:12.810153 28293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:12.811189 28293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:12.819555 28302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:12.819571 28299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:12.819648 28293 server_base.cc:1034] running on GCE node
W20260807 22:50:12.819610 28300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:12.820466 28293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:12.821544 28293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:12.822701 28293 hybrid_clock.cc:648] HybridClock initialized: now 1786143012822684 us; error 30 us; skew 500 ppm
Aug 07 22:50:12 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143012, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:12.825374 28293 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:50:12.826503 28293 webserver.cc:460] Webserver started at http://127.12.112.254:33037/ using document root <none> and password file <none>
I20260807 22:50:12.827225 28293 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:12.827325 28293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:12.831003 28293 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 22:50:12.833026 28310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:12.834221 28293 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:50:12.834403 28293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "6d140683bfb140b19f644a141ee12617"
format_stamp: "Formatted at 2026-08-07 22:50:10 on dist-test-slave-tm1g"
server_key: "917c731702fcf04be115745d3115a852"
server_key_iv: "7390b8ba7f044c54ab46805bdfca95b8"
server_key_version: "encryptionkey@0"
I20260807 22:50:12.834951 28293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:12.850966 28293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:12.853717 28293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:12.853929 28293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:12.860957 28293 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:36567
I20260807 22:50:12.861248 28368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:36567 every 8 connection(s)
I20260807 22:50:12.862043 28293 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:50:12.865391 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 28293
I20260807 22:50:12.865911 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:40613
--local_ip_for_outbound_sockets=127.12.112.193
--tserver_master_addrs=127.12.112.254:36567
--webserver_port=46133
--webserver_interface=127.12.112.193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:50:12.866634 28369 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:50:12.868767 28369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Bootstrap starting.
I20260807 22:50:12.886127 28369 log.cc:824] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:12.897333 28369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:50:12.897722 28369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617: Bootstrap complete.
I20260807 22:50:12.901885 28369 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:12.902254 28369 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d140683bfb140b19f644a141ee12617, State: Initialized, Role: FOLLOWER
I20260807 22:50:12.902786 28369 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:12.902899 28369 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:50:12.902987 28369 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:50:12.903103 28369 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:50:12.904891 28369 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:12.905205 28369 leader_election.cc:302] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d140683bfb140b19f644a141ee12617; no voters:
I20260807 22:50:12.905546 28369 leader_election.cc:288] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 22:50:12.905649 28373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 22:50:12.905833 28373 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [term 3 LEADER]: Becoming Leader. State: Replica: 6d140683bfb140b19f644a141ee12617, State: Running, Role: LEADER
I20260807 22:50:12.906178 28373 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } }
I20260807 22:50:12.906757 28369 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:50:12.907171 28373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d140683bfb140b19f644a141ee12617. Latest consensus state: current_term: 3 leader_uuid: "6d140683bfb140b19f644a141ee12617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } } }
I20260807 22:50:12.907361 28373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:12.907609 28374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6d140683bfb140b19f644a141ee12617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d140683bfb140b19f644a141ee12617" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 36567 } } }
I20260807 22:50:12.907791 28374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d140683bfb140b19f644a141ee12617 [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:12.907804 28377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:50:12.913151 28377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:50:12.913862 28377 catalog_manager.cc:1259] Loaded cluster ID: 18110d1f0d4a47e1bf331c9eab51daeb
I20260807 22:50:12.913923 28377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 22:50:12.915040 28377 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fda1fe499ad google::LogMessage::Fail() at ??:0
@ 0x7fda1fe4c88a google::LogMessage::SendToLog() at ??:0
@ 0x7fda1fe494de google::LogMessage::Flush() at ??:0
@ 0x7fda1fe4aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fda2a788fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fda2a789d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fda2a786579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fda2a7ca640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fda2209b3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fda2209bc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fda2209d3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fda2208c512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fda236d06db start_thread at ??:0
@ 0x7fda1e94761f clone at ??:0
W20260807 22:50:13.011503 28371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:13.011857 28371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:13.011921 28371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:13.018077 28371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:13.018164 28371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:13.018253 28371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:50:13.026055 28371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:40613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=46133
--tserver_master_addrs=127.12.112.254:36567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:13.027524 28371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:13.028885 28371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:13.041214 28415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:13.041232 28416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:13.041534 28371 server_base.cc:1034] running on GCE node
W20260807 22:50:13.041226 28418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:13.042003 28371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:13.042891 28371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:13.044108 28371 hybrid_clock.cc:648] HybridClock initialized: now 1786143013044078 us; error 48 us; skew 500 ppm
Aug 07 22:50:13 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:13.047482 28371 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:50:13.048316 28371 webserver.cc:460] Webserver started at http://127.12.112.193:46133/ using document root <none> and password file <none>
I20260807 22:50:13.048872 28371 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:13.048938 28371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:13.052935 28371 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:50:13.055181 28426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:13.056501 28371 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:13.056650 28371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "73e6030a0a464de29d254f53c321f340"
format_stamp: "Formatted at 2026-08-07 22:50:10 on dist-test-slave-tm1g"
server_key: "063289d925db46f7f47af07548794626"
server_key_iv: "22d7cf06c0bb95efca9dced9da055703"
server_key_version: "encryptionkey@0"
I20260807 22:50:13.057193 28371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:13.091382 28371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:13.094848 28371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:13.095072 28371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:13.095700 28371 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:13.096853 28436 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:50:13.102288 28371 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:50:13.102420 28371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260807 22:50:13.102507 28371 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:50:13.104146 28371 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:50:13.104216 28371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 22:50:13.104514 28436 tablet_bootstrap.cc:492] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Bootstrap starting.
I20260807 22:50:13.115213 28371 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:40613
I20260807 22:50:13.115454 28554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:40613 every 8 connection(s)
I20260807 22:50:13.116226 28371 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:50:13.124027 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 28371
I20260807 22:50:13.124493 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:32927
--local_ip_for_outbound_sockets=127.12.112.194
--tserver_master_addrs=127.12.112.254:36567
--webserver_port=44767
--webserver_interface=127.12.112.194
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:50:13.126853 28436 log.cc:824] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:13.134053 28436 tablet_bootstrap.cc:492] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:50:13.134511 28436 tablet_bootstrap.cc:492] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Bootstrap complete.
I20260807 22:50:13.135684 28436 ts_tablet_manager.cc:1397] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Time spent bootstrapping tablet: real 0.031s user 0.021s sys 0.008s
I20260807 22:50:13.138080 28436 raft_consensus.cc:348] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:13.138571 28436 raft_consensus.cc:729] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73e6030a0a464de29d254f53c321f340, State: Initialized, Role: FOLLOWER
I20260807 22:50:13.139056 28436 consensus_queue.cc:260] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:13.140082 28436 ts_tablet_manager.cc:1428] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20260807 22:50:13.153501 28557 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:50:13.118236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:42739)
0807 22:50:13.118798 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:13.118850 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:13.119669 (+ 819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:13.152722 (+ 33053us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":149,"threads_started":1}
W20260807 22:50:13.154129 28555 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:36567 (0 consecutive failures): Network error: Failed to ping master at 127.12.112.254:36567: Client connection negotiation failed: client connection to 127.12.112.254:36567: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 22:50:13.154938 28557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:13.154677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:60377)
0807 22:50:13.154805 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:13.154875 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 22:50:13.155635 28557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:13.155425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:58667)
0807 22:50:13.155532 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:13.155579 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 22:50:13.155833 28555 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:50:13.243358 28558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:13.243605 28558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:13.243649 28558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:13.247654 28558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:13.247709 28558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:13.247766 28558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:50:13.252966 28558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:32927
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=44767
--tserver_master_addrs=127.12.112.254:36567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:13.254247 28558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:13.255271 28558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:13.264912 28566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:13.264866 28568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:13.264866 28565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:13.265292 28558 server_base.cc:1034] running on GCE node
I20260807 22:50:13.265717 28558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:13.266386 28558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:13.267593 28558 hybrid_clock.cc:648] HybridClock initialized: now 1786143013267575 us; error 34 us; skew 500 ppm
Aug 07 22:50:13 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:13.270437 28558 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:50:13.271200 28558 webserver.cc:460] Webserver started at http://127.12.112.194:44767/ using document root <none> and password file <none>
I20260807 22:50:13.271700 28558 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:13.271759 28558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:13.275547 28558 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:50:13.277506 28575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:13.278812 28558 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:13.278934 28558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "3057192b03594be2b48bb855e636656e"
format_stamp: "Formatted at 2026-08-07 22:50:11 on dist-test-slave-tm1g"
server_key: "5a8fd9056aee464e17d0accfe80a6e8f"
server_key_iv: "dca51e0c03c5f67c871a06f68fe634f1"
server_key_version: "encryptionkey@0"
I20260807 22:50:13.279459 28558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:13.301617 28558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:13.304900 28558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:13.305109 28558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:13.305727 28558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:13.306564 28558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:13.306610 28558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:13.306651 28558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:13.306705 28558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:13.315902 28558 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:32927
I20260807 22:50:13.315938 28698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:32927 every 8 connection(s)
I20260807 22:50:13.316895 28558 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:50:13.320585 28701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:13.318986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:53607)
0807 22:50:13.319469 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:13.319894 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":114,"threads_started":1}
W20260807 22:50:13.321058 28699 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:36567 (0 consecutive failures): Network error: Failed to ping master at 127.12.112.254:36567: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
I20260807 22:50:13.321679 28701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:13.321457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:34949)
0807 22:50:13.321572 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:13.321622 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 22:50:13.322283 28701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:13.322102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:60183)
0807 22:50:13.322197 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:13.322239 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 22:50:13.322508 28699 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 22:50:13.323026 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 28558
I20260807 22:50:13.323406 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:46555
--local_ip_for_outbound_sockets=127.12.112.195
--tserver_master_addrs=127.12.112.254:36567
--webserver_port=42891
--webserver_interface=127.12.112.195
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:13.433634 28702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:13.433934 28702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:13.434015 28702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:13.438114 28702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:13.438195 28702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:13.438279 28702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:50:13.443555 28702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:46555
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=42891
--tserver_master_addrs=127.12.112.254:36567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:13.444604 28702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:13.445640 28702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:13.455207 28708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:13.455202 28711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:13.455204 28707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:13.455451 28702 server_base.cc:1034] running on GCE node
I20260807 22:50:13.455974 28702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:13.456632 28702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:13.457799 28702 hybrid_clock.cc:648] HybridClock initialized: now 1786143013457772 us; error 42 us; skew 500 ppm
Aug 07 22:50:13 dist-test-slave-tm1g krb5kdc[27134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:13.460676 28702 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:50:13.461722 28702 webserver.cc:460] Webserver started at http://127.12.112.195:42891/ using document root <none> and password file <none>
I20260807 22:50:13.462292 28702 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:13.462435 28702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:13.466095 28702 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:50:13.468182 28718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:13.469359 28702 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:13.469496 28702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "0256fb265eb04c929ead8227d87c8e72"
format_stamp: "Formatted at 2026-08-07 22:50:11 on dist-test-slave-tm1g"
server_key: "9d3b8520e54ea65b40337ab9dcdff32c"
server_key_iv: "91c3419bce6c6d6abf1b97e70aa1de87"
server_key_version: "encryptionkey@0"
I20260807 22:50:13.470029 28702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:13.485528 28702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:13.488360 28702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:13.488521 28702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:13.489019 28702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:13.489773 28702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:13.489818 28702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:13.489857 28702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:13.489872 28702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:13.498617 28702 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:46555
I20260807 22:50:13.498706 28844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:46555 every 8 connection(s)
I20260807 22:50:13.499607 28702 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:50:13.500461 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 28702
I20260807 22:50:13.503459 28849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:13.501843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:53025)
0807 22:50:13.502296 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:13.502784 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":118,"threads_started":1}
W20260807 22:50:13.503896 28845 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:36567 (0 consecutive failures): Network error: Failed to ping master at 127.12.112.254:36567: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
I20260807 22:50:13.504448 28849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:13.504245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:59925)
0807 22:50:13.504341 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:13.504396 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 22:50:13.505046 28849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:13.504843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:42925)
0807 22:50:13.504949 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:13.505002 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 22:50:13.505261 28845 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 22:50:14.156942 28851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:14.156465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:34323)
0807 22:50:14.156743 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:14.156806 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":76,"threads_started":1}
I20260807 22:50:14.323374 28852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:14.322985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:47253)
0807 22:50:14.323212 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:14.323265 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":73,"threads_started":1}
I20260807 22:50:14.506166 28853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:14.505753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:36181)
0807 22:50:14.506010 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:14.506063 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":68,"threads_started":1}
I20260807 22:50:14.701542 28854 raft_consensus.cc:482] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:50:14.701789 28854 raft_consensus.cc:504] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:14.702927 28854 leader_election.cc:288] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3057192b03594be2b48bb855e636656e (127.12.112.194:32927), 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555)
Aug 07 22:50:14 dist-test-slave-tm1g krb5kdc[27134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.194@KRBTEST.COM
Aug 07 22:50:14 dist-test-slave-tm1g krb5kdc[27134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.195@KRBTEST.COM
I20260807 22:50:14.723464 28856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:14.703170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:32927 (local address 127.12.112.193:59175)
0807 22:50:14.703628 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:14.703643 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:14.703756 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:14.705231 (+ 1475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:14.705236 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:14.705803 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:14.706246 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:14.706261 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:14.707794 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:14.707797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:14.709057 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:14.709068 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:14.710037 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:14.710041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:14.710364 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:14.716243 (+ 5879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:14.716270 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:14.718252 (+ 1982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:14.720808 (+ 2556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:14.720817 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:14.720833 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:14.721213 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:14.721604 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:14.721607 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:14.721609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:14.721793 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:14.722494 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:14.722501 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:14.722729 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 22:50:14.722918 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 22:50:14.723260 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":366,"spinlock_wait_cycles":33792,"thread_start_us":80,"threads_started":1}
I20260807 22:50:14.723485 28857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:14.703327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:39147 (local address 127.12.112.195:46555)
0807 22:50:14.703870 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:14.703890 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:14.703924 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:50:14.704553 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:14.704558 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:14.704872 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:14.705181 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:14.706475 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:14.707439 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:14.709187 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:14.709890 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:14.710065 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:14.718825 (+ 8760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:14.718829 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:14.718839 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:14.718868 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:14.721005 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:14.721490 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:14.721494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:14.721498 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:14.721652 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:14.721969 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:14.721972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:14.721973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:14.722386 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:14.722542 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:14.723031 (+ 489us) server_negotiation.cc:299] Negotiation successful
0807 22:50:14.723282 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":83,"threads_started":1}
I20260807 22:50:14.723511 28858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:14.703439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:59175 (local address 127.12.112.194:32927)
0807 22:50:14.703763 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:14.703806 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:14.703854 (+ 48us) server_negotiation.cc:407] Connection header received
0807 22:50:14.704536 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:14.704542 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:14.704873 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:14.705175 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:14.706533 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:14.707668 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:14.709336 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:14.709917 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:14.710065 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:14.718577 (+ 8512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:14.718584 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:14.718600 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:14.718633 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:14.720689 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:14.721348 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:14.721354 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:14.721360 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:14.721511 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:14.721884 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:14.721887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:14.721889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:14.722379 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:14.722510 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:14.723027 (+ 517us) server_negotiation.cc:299] Negotiation successful
0807 22:50:14.723318 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":93,"threads_started":1}
I20260807 22:50:14.723513 28855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:14.703170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:46555 (local address 127.12.112.193:39147)
0807 22:50:14.703505 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:14.703523 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:14.703634 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:14.705230 (+ 1596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:14.705236 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:14.705804 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:14.706247 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:14.706262 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:14.707583 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:14.707586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:14.709057 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:14.709068 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:14.710037 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:14.710041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:14.710364 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:14.716243 (+ 5879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:14.716282 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:14.718622 (+ 2340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:14.721127 (+ 2505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:14.721129 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:14.721131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:14.721372 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:14.721754 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:14.721756 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:14.721758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:14.721873 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:14.722519 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:14.722524 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:14.722728 (+ 204us) client_negotiation.cc:769] Sending connection context
0807 22:50:14.722918 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 22:50:14.723348 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":361,"spinlock_wait_cycles":68992,"thread_start_us":81,"threads_started":1}
W20260807 22:50:14.726169 28431 leader_election.cc:341] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3057192b03594be2b48bb855e636656e (127.12.112.194:32927): Not found: Tablet not found: f0832e81e01042dcb60ce1929d35b8d1
W20260807 22:50:14.726853 28432 leader_election.cc:341] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555): Not found: Tablet not found: f0832e81e01042dcb60ce1929d35b8d1
I20260807 22:50:14.726939 28432 leader_election.cc:302] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73e6030a0a464de29d254f53c321f340; no voters: 0256fb265eb04c929ead8227d87c8e72, 3057192b03594be2b48bb855e636656e
I20260807 22:50:14.727195 28854 raft_consensus.cc:2726] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:50:15.158134 28855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:15.157759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:35359)
0807 22:50:15.157987 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:15.158047 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
I20260807 22:50:15.324499 28860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:15.324093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:59527)
0807 22:50:15.324358 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:15.324412 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":72,"threads_started":1}
I20260807 22:50:15.507299 28861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:15.506885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:36119)
0807 22:50:15.507162 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:15.507215 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":83,"threads_started":1}
I20260807 22:50:16.159494 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:16.159068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:52391)
0807 22:50:16.159337 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:16.159390 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":88,"threads_started":1}
I20260807 22:50:16.259680 28863 raft_consensus.cc:482] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:50:16.259819 28863 raft_consensus.cc:504] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:16.260301 28863 leader_election.cc:288] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3057192b03594be2b48bb855e636656e (127.12.112.194:32927), 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555)
W20260807 22:50:16.261199 28432 leader_election.cc:341] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555): Not found: Tablet not found: f0832e81e01042dcb60ce1929d35b8d1
W20260807 22:50:16.261313 28431 leader_election.cc:341] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3057192b03594be2b48bb855e636656e (127.12.112.194:32927): Not found: Tablet not found: f0832e81e01042dcb60ce1929d35b8d1
I20260807 22:50:16.261384 28431 leader_election.cc:302] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73e6030a0a464de29d254f53c321f340; no voters: 0256fb265eb04c929ead8227d87c8e72, 3057192b03594be2b48bb855e636656e
I20260807 22:50:16.261528 28863 raft_consensus.cc:2726] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:50:16.325757 28864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:16.325278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:47245)
0807 22:50:16.325590 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:16.325648 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":93,"threads_started":1}
I20260807 22:50:16.508522 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:16.508100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:34301)
0807 22:50:16.508358 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:16.508415 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":85,"threads_started":1}
I20260807 22:50:17.160609 28866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:17.160212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:59477)
0807 22:50:17.160459 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:17.160512 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":80,"threads_started":1}
I20260807 22:50:17.326982 28867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:17.326560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:40695)
0807 22:50:17.326822 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:17.326883 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":106,"threads_started":1}
I20260807 22:50:17.509582 28869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:17.509198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:45679)
0807 22:50:17.509445 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:17.509497 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":83,"threads_started":1}
I20260807 22:50:18.161926 28870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:18.161408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:45343)
0807 22:50:18.161754 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:18.161816 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":74,"threads_started":1}
I20260807 22:50:18.328186 28872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:18.327772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:45535)
0807 22:50:18.328037 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:18.328093 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":96,"threads_started":1}
I20260807 22:50:18.510771 28874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:18.510372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:51647)
0807 22:50:18.510614 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:18.510668 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":76,"threads_started":1}
I20260807 22:50:18.643499 28875 raft_consensus.cc:482] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:50:18.643687 28875 raft_consensus.cc:504] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:18.644165 28875 leader_election.cc:288] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3057192b03594be2b48bb855e636656e (127.12.112.194:32927), 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555)
W20260807 22:50:18.644927 28431 leader_election.cc:341] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3057192b03594be2b48bb855e636656e (127.12.112.194:32927): Not found: Tablet not found: f0832e81e01042dcb60ce1929d35b8d1
W20260807 22:50:18.645067 28432 leader_election.cc:341] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555): Not found: Tablet not found: f0832e81e01042dcb60ce1929d35b8d1
I20260807 22:50:18.645169 28432 leader_election.cc:302] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73e6030a0a464de29d254f53c321f340; no voters: 0256fb265eb04c929ead8227d87c8e72, 3057192b03594be2b48bb855e636656e
I20260807 22:50:18.645316 28875 raft_consensus.cc:2726] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:50:19.163064 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:19.162674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:60207)
0807 22:50:19.162916 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:19.162968 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":83,"threads_started":1}
I20260807 22:50:19.329252 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:19.328882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:36443)
0807 22:50:19.329114 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:19.329166 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":70,"threads_started":1}
I20260807 22:50:19.511813 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:19.511429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:49499)
0807 22:50:19.511668 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:19.511718 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":86,"threads_started":1}
I20260807 22:50:20.164382 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:20.163768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:39477)
0807 22:50:20.164150 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:20.164211 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":130,"threads_started":1}
I20260807 22:50:20.330462 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:20.329987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:58883)
0807 22:50:20.330263 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:20.330368 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":71,"threads_started":1}
I20260807 22:50:20.513176 28881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:20.512671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:50597)
0807 22:50:20.513009 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:20.513084 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":111,"threads_started":1}
I20260807 22:50:21.165501 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:21.165085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:46981)
0807 22:50:21.165353 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:21.165403 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":96,"threads_started":1}
I20260807 22:50:21.331660 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:21.331205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:48273)
0807 22:50:21.331485 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:21.331543 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":114,"threads_started":1}
I20260807 22:50:21.514448 28885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:21.513958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:55119)
0807 22:50:21.514227 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:21.514284 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":92,"threads_started":1}
I20260807 22:50:22.166775 28886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:22.166281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:52671)
0807 22:50:22.166609 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:22.166665 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":97,"threads_started":1}
I20260807 22:50:22.332926 28887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:22.332450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:54705)
0807 22:50:22.332755 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:22.332823 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":102,"threads_started":1}
I20260807 22:50:22.428020 28888 raft_consensus.cc:482] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:50:22.428153 28888 raft_consensus.cc:504] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3057192b03594be2b48bb855e636656e" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 32927 } } peers { permanent_uuid: "0256fb265eb04c929ead8227d87c8e72" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 46555 } } peers { permanent_uuid: "73e6030a0a464de29d254f53c321f340" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40613 } }
I20260807 22:50:22.428663 28888 leader_election.cc:288] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3057192b03594be2b48bb855e636656e (127.12.112.194:32927), 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555)
W20260807 22:50:22.429505 28431 leader_election.cc:341] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3057192b03594be2b48bb855e636656e (127.12.112.194:32927): Not found: Tablet not found: f0832e81e01042dcb60ce1929d35b8d1
W20260807 22:50:22.429613 28432 leader_election.cc:341] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0256fb265eb04c929ead8227d87c8e72 (127.12.112.195:46555): Not found: Tablet not found: f0832e81e01042dcb60ce1929d35b8d1
I20260807 22:50:22.429730 28432 leader_election.cc:302] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73e6030a0a464de29d254f53c321f340; no voters: 0256fb265eb04c929ead8227d87c8e72, 3057192b03594be2b48bb855e636656e
I20260807 22:50:22.429900 28888 raft_consensus.cc:2726] T f0832e81e01042dcb60ce1929d35b8d1 P 73e6030a0a464de29d254f53c321f340 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:50:22.515605 28889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:22.515197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:48465)
0807 22:50:22.515458 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:22.515513 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":81,"threads_started":1}
I20260807 22:50:23.168085 28890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:23.167642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:40935)
0807 22:50:23.167925 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:23.167981 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":102,"threads_started":1}
I20260807 22:50:23.334105 28891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:23.333700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:39085)
0807 22:50:23.333955 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:23.334009 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":83,"threads_started":1}
I20260807 22:50:23.516741 28892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:23.516339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:33973)
0807 22:50:23.516598 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:23.516653 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":89,"threads_started":1}
I20260807 22:50:24.169340 28893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:24.168892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:42673)
0807 22:50:24.169177 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:24.169233 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":77,"threads_started":1}
I20260807 22:50:24.335348 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:24.334907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:40833)
0807 22:50:24.335181 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:24.335235 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":92,"threads_started":1}
I20260807 22:50:24.517969 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:24.517473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:45959)
0807 22:50:24.517794 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:24.517859 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":84,"threads_started":1}
I20260807 22:50:25.170620 28896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:25.170161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:40215)
0807 22:50:25.170468 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:25.170524 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":85,"threads_started":1}
I20260807 22:50:25.336576 28897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:25.336134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:60203)
0807 22:50:25.336406 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:25.336468 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":75,"threads_started":1}
I20260807 22:50:25.519245 28899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:25.518810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:35653)
0807 22:50:25.519086 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:25.519145 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":77,"threads_started":1}
I20260807 22:50:26.171725 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:26.171321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:40825)
0807 22:50:26.171572 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:26.171625 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":77,"threads_started":1}
I20260807 22:50:26.337723 28901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:26.337324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:48453)
0807 22:50:26.337571 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:26.337627 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":74,"threads_started":1}
I20260807 22:50:26.520473 28903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:26.520050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:41095)
0807 22:50:26.520303 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:26.520373 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":76,"threads_started":1}
I20260807 22:50:27.172997 28904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:27.172483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:42593)
0807 22:50:27.172796 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:27.172890 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":79,"threads_started":1}
I20260807 22:50:27.338951 28905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:27.338537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:54653)
0807 22:50:27.338803 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:27.338857 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":94,"threads_started":1}
I20260807 22:50:27.521607 28906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:27.521195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.195:47487)
0807 22:50:27.521452 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:27.521513 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":81,"threads_started":1}
I20260807 22:50:28.174437 28908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:28.173864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.193:48683)
0807 22:50:28.174169 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:28.174225 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":97,"threads_started":1}
I20260807 22:50:28.340206 28909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:28.339819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:36567 (local address 127.12.112.194:40207)
0807 22:50:28.340057 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:28.340111 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:36567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":75,"threads_started":1}
I20260807 22:50:28.504199 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 28371
I20260807 22:50:28.511618 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 28558
I20260807 22:50:28.518646 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 28702
2026-08-07T22:50:28Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19117 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:50:28 dist-test-slave-tm1g krb5kdc[28912](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:50:28 dist-test-slave-tm1g krb5kdc[28912](info): set up 2 sockets
Aug 07 22:50:28 dist-test-slave-tm1g krb5kdc[28912](info): commencing operation
krb5kdc: starting...
W20260807 22:50:29.581657 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:50:29 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:50:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:50:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:50:29.705862 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:46073
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:46073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:29.818260 28926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:29.818575 28926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:29.818645 28926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:29.822657 28926 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 22:50:29.822724 28926 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 22:50:29.822751 28926 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 22:50:29.822780 28926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:50:29.822824 28926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:29.822862 28926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:29.822916 28926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:50:29.822948 28926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:50:29.828294 28926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:46073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:46073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:29.829339 28926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:29.830416 28926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:29.839073 28934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:29.839262 28926 server_base.cc:1034] running on GCE node
W20260807 22:50:29.839082 28931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:29.839150 28932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:29.839929 28926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:29.840958 28926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:29.842147 28926 hybrid_clock.cc:648] HybridClock initialized: now 1786143029842121 us; error 38 us; skew 500 ppm
Aug 07 22:50:29 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143029, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:29.844945 28926 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:50:29.845810 28926 webserver.cc:460] Webserver started at http://127.12.112.254:41917/ using document root <none> and password file <none>
I20260807 22:50:29.846354 28926 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:29.846436 28926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:29.846607 28926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:29.848546 28926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "26076d742dc9419da95c5b90a9b0174a"
format_stamp: "Formatted at 2026-08-07 22:50:29 on dist-test-slave-tm1g"
server_key: "fccd38aac35c5bc2b9cb0cb5a3845df8"
server_key_iv: "fe96851cdfed35076179fc844291d75b"
server_key_version: "encryptionkey@0"
I20260807 22:50:29.849030 28926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "26076d742dc9419da95c5b90a9b0174a"
format_stamp: "Formatted at 2026-08-07 22:50:29 on dist-test-slave-tm1g"
server_key: "fccd38aac35c5bc2b9cb0cb5a3845df8"
server_key_iv: "fe96851cdfed35076179fc844291d75b"
server_key_version: "encryptionkey@0"
I20260807 22:50:29.852555 28926 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:50:29.854787 28943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:29.855922 28926 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:50:29.856052 28926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "26076d742dc9419da95c5b90a9b0174a"
format_stamp: "Formatted at 2026-08-07 22:50:29 on dist-test-slave-tm1g"
server_key: "fccd38aac35c5bc2b9cb0cb5a3845df8"
server_key_iv: "fe96851cdfed35076179fc844291d75b"
server_key_version: "encryptionkey@0"
I20260807 22:50:29.856150 28926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:29.873863 28926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:29.876784 28926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:29.876981 28926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:29.883915 28926 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:46073
I20260807 22:50:29.884225 28999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:46073 every 8 connection(s)
I20260807 22:50:29.884861 28926 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:50:29.887562 29000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:29.892186 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 28926
I20260807 22:50:29.892342 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:50:29.892673 12739 external_mini_cluster.cc:1428] Setting key d6e71280e97671e893e1269f89ae77d2
I20260807 22:50:29.893429 29000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Bootstrap starting.
I20260807 22:50:29.895802 29000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:29.896863 29000 log.cc:824] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:29.898864 29000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: No bootstrap required, opened a new log
Aug 07 22:50:29 dist-test-slave-tm1g krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:29.903193 29000 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:50:29.903479 29000 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:29.903554 29000 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26076d742dc9419da95c5b90a9b0174a, State: Initialized, Role: FOLLOWER
I20260807 22:50:29.904026 29000 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:50:29.904153 29000 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:50:29.904237 29000 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:50:29.904361 29000 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:29.905198 29000 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:50:29.905587 29000 leader_election.cc:302] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26076d742dc9419da95c5b90a9b0174a; no voters:
I20260807 22:50:29.905925 29000 leader_election.cc:288] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:50:29.906016 29005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:50:29.906287 29005 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 1 LEADER]: Becoming Leader. State: Replica: 26076d742dc9419da95c5b90a9b0174a, State: Running, Role: LEADER
I20260807 22:50:29.906693 29005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:50:29.907212 29000 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:50:29.908205 29003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:29.894122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35332 (local address 127.12.112.254:46073)
0807 22:50:29.894582 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:29.894596 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:29.894632 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:50:29.895233 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:29.895248 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:29.895553 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:29.895979 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:29.896955 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:29.897971 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:29.899142 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:29.899589 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:29.899709 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:29.902477 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:29.902482 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:29.902494 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:29.902521 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:29.904483 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:29.904928 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:29.904934 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:29.904940 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:29.905062 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:29.905432 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:29.905435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:29.905437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:29.905955 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:29.906204 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:29.906916 (+ 712us) server_negotiation.cc:299] Negotiation successful
0807 22:50:29.907209 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":192,"threads_started":1}
I20260807 22:50:29.908305 29007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26076d742dc9419da95c5b90a9b0174a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } } }
I20260807 22:50:29.908406 29007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:29.908666 29007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26076d742dc9419da95c5b90a9b0174a. Latest consensus state: current_term: 1 leader_uuid: "26076d742dc9419da95c5b90a9b0174a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } } }
I20260807 22:50:29.908831 29007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: This master's current role is: LEADER
W20260807 22:50:29.911746 29021 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:50:29.911821 29021 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:50:29.911900 29014 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:50:29.912743 29014 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:50:29.918499 29014 catalog_manager.cc:1347] Generated new cluster ID: aaae44fb66574199835b08d757fb6798
I20260807 22:50:29.918581 29014 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:50:29.931419 29014 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:50:29.932333 29014 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:50:29.940279 29014 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Generated new TSK 0
I20260807 22:50:29.940948 29014 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:50:29.973547 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:46073
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:30.085180 29027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:30.085482 29027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:30.085554 29027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:30.089516 29027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:30.089594 29027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:30.089680 29027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:50:30.094803 29027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:30.095814 29027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:30.096962 29027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:30.106190 29036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:30.106233 29034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:30.106249 29032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:30.106323 29027 server_base.cc:1034] running on GCE node
I20260807 22:50:30.106825 29027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:30.107450 29027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:30.108631 29027 hybrid_clock.cc:648] HybridClock initialized: now 1786143030108591 us; error 58 us; skew 500 ppm
Aug 07 22:50:30 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143030, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:30.111469 29027 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:50:30.112254 29027 webserver.cc:460] Webserver started at http://127.12.112.193:33845/ using document root <none> and password file <none>
I20260807 22:50:30.112744 29027 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:30.112802 29027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:30.112967 29027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:30.114987 29027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "96643797a37940c6b2178a4df4bc22b0"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "6927d6c8f5998ec66afc2a502821f1a9"
server_key_iv: "36abdc30695fec0266f3869a88a2928d"
server_key_version: "encryptionkey@0"
I20260807 22:50:30.115475 29027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "96643797a37940c6b2178a4df4bc22b0"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "6927d6c8f5998ec66afc2a502821f1a9"
server_key_iv: "36abdc30695fec0266f3869a88a2928d"
server_key_version: "encryptionkey@0"
I20260807 22:50:30.118847 29027 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:50:30.121027 29044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:30.122123 29027 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:30.122210 29027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "96643797a37940c6b2178a4df4bc22b0"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "6927d6c8f5998ec66afc2a502821f1a9"
server_key_iv: "36abdc30695fec0266f3869a88a2928d"
server_key_version: "encryptionkey@0"
I20260807 22:50:30.122287 29027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:30.139204 29027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:30.141733 29027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:30.141878 29027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:30.142454 29027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:30.143239 29027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:30.143285 29027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:30.143324 29027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:30.143340 29027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:30.152489 29027 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:40149
I20260807 22:50:30.152520 29163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:40149 every 8 connection(s)
I20260807 22:50:30.153308 29027 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:50:30.153951 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 29027
I20260807 22:50:30.154095 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:50:30.154480 12739 external_mini_cluster.cc:1428] Setting key 430dfce2dfb3a4ec40d6007a020bdb83
Aug 07 22:50:30 dist-test-slave-tm1g krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143030, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:50:30.167194 29003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.155208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:41237 (local address 127.12.112.254:46073)
0807 22:50:30.155354 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:30.155359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:30.156392 (+ 1033us) server_negotiation.cc:407] Connection header received
0807 22:50:30.157294 (+ 902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:30.157297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:30.157349 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:30.157429 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:30.158599 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.159203 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.160445 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.160680 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.160796 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.163654 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:30.163657 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:30.163659 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:30.163682 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:30.165212 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:30.165699 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:30.165702 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:30.165703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:30.165778 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:30.166151 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:30.166154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:30.166155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:30.166388 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:30.166476 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:30.166958 (+ 482us) server_negotiation.cc:299] Negotiation successful
0807 22:50:30.167067 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
I20260807 22:50:30.168129 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.155560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:41237)
0807 22:50:30.156249 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:30.156300 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:30.157101 (+ 801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:30.157598 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:30.157604 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:30.157938 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:30.158457 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.158473 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.159346 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.159350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.160317 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.160327 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.160833 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.160837 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.161016 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.161648 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:30.161663 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:30.163480 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:30.165341 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:30.165347 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:30.165367 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:30.165613 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:30.165859 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:30.165861 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:30.165862 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:30.166061 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:30.166485 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:30.166489 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:30.166710 (+ 221us) client_negotiation.cc:769] Sending connection context
0807 22:50:30.166924 (+ 214us) client_negotiation.cc:240] Negotiation successful
0807 22:50:30.167174 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":132,"threads_started":1}
I20260807 22:50:30.169471 29164 heartbeater.cc:347] Connected to a master server at 127.12.112.254:46073
I20260807 22:50:30.169740 29164 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:30.170378 29164 heartbeater.cc:511] Master 127.12.112.254:46073 requested a full tablet report, sending...
I20260807 22:50:30.172338 28960 ts_manager.cc:194] Registered new tserver with Master: 96643797a37940c6b2178a4df4bc22b0 (127.12.112.193:40149)
I20260807 22:50:30.174016 28960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:41237
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:50:30.183657 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:46073
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:30.291376 29169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:30.291651 29169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:30.291725 29169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:30.295660 29169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:30.295738 29169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:30.295822 29169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:50:30.300797 29169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:30.301776 29169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:30.302843 29169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:30.312469 29179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:30.312500 29177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:30.312501 29169 server_base.cc:1034] running on GCE node
W20260807 22:50:30.312518 29176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:30.313037 29169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:30.313620 29169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:30.314797 29169 hybrid_clock.cc:648] HybridClock initialized: now 1786143030314783 us; error 33 us; skew 500 ppm
Aug 07 22:50:30 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143030, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:30.317405 29169 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:50:30.318238 29169 webserver.cc:460] Webserver started at http://127.12.112.194:36137/ using document root <none> and password file <none>
I20260807 22:50:30.318792 29169 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:30.318882 29169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:30.319116 29169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:30.321059 29169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "83ee8adc4ef542198b471d659adcf0eb"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "b2b665ad0176d0ecf3c96ceb0e95c5d4"
server_key_iv: "26b90758501a7cd85afa4fd8bdb0978b"
server_key_version: "encryptionkey@0"
I20260807 22:50:30.321617 29169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "83ee8adc4ef542198b471d659adcf0eb"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "b2b665ad0176d0ecf3c96ceb0e95c5d4"
server_key_iv: "26b90758501a7cd85afa4fd8bdb0978b"
server_key_version: "encryptionkey@0"
I20260807 22:50:30.325140 29169 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:50:30.327605 29186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:30.328775 29169 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:50:30.328905 29169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "83ee8adc4ef542198b471d659adcf0eb"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "b2b665ad0176d0ecf3c96ceb0e95c5d4"
server_key_iv: "26b90758501a7cd85afa4fd8bdb0978b"
server_key_version: "encryptionkey@0"
I20260807 22:50:30.329021 29169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:30.350467 29169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:30.353178 29169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:30.353381 29169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:30.353953 29169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:30.354822 29169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:30.354898 29169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:30.354969 29169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:30.355012 29169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:30.364006 29169 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:44315
I20260807 22:50:30.364037 29306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:44315 every 8 connection(s)
I20260807 22:50:30.364856 29169 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:50:30.369831 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 29169
I20260807 22:50:30.369974 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:50:30.370275 12739 external_mini_cluster.cc:1428] Setting key 989c4f872b5cfac6d9e346c124bfeffe
Aug 07 22:50:30 dist-test-slave-tm1g krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143030, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:30.378492 29003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.366605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:42747 (local address 127.12.112.254:46073)
0807 22:50:30.366754 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:30.366758 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:30.367747 (+ 989us) server_negotiation.cc:407] Connection header received
0807 22:50:30.368616 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:30.368619 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:30.368679 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:30.368757 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:30.369851 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.370571 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.371869 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.372108 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.372220 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.374894 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:30.374897 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:30.374899 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:30.374922 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:30.376427 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:30.376937 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:30.376941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:30.376943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:30.377025 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:30.377372 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:30.377376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:30.377378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:30.377564 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:30.377671 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:30.378147 (+ 476us) server_negotiation.cc:299] Negotiation successful
0807 22:50:30.378273 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:50:30.379264 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.366970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:42747)
0807 22:50:30.367598 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:30.367637 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:30.368403 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:30.368911 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:30.368919 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:30.369248 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:30.369699 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.369711 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.370697 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.370708 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.371750 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.371759 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.372256 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.372260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.372424 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.373022 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:30.373037 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:30.374714 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:30.376550 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:30.376555 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:30.376568 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:30.376825 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:30.377120 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:30.377124 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:30.377126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:30.377264 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:30.377670 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:30.377676 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:30.377909 (+ 233us) client_negotiation.cc:769] Sending connection context
0807 22:50:30.378092 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 22:50:30.378441 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:50:30.380407 29307 heartbeater.cc:347] Connected to a master server at 127.12.112.254:46073
I20260807 22:50:30.380612 29307 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:30.381093 29307 heartbeater.cc:511] Master 127.12.112.254:46073 requested a full tablet report, sending...
I20260807 22:50:30.382057 28960 ts_manager.cc:194] Registered new tserver with Master: 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:50:30.382871 28960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:42747
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:50:30.397446 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:46073
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:30.506389 29314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:30.506608 29314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:30.506686 29314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:30.510895 29314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:30.510949 29314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:30.511054 29314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:50:30.516105 29314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:30.517041 29314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:30.518018 29314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:30.527522 29322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:30.527599 29314 server_base.cc:1034] running on GCE node
W20260807 22:50:30.527535 29319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:30.527805 29320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:30.528182 29314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:30.528820 29314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:30.530002 29314 hybrid_clock.cc:648] HybridClock initialized: now 1786143030529991 us; error 26 us; skew 500 ppm
Aug 07 22:50:30 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143030, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:30.532714 29314 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:50:30.533548 29314 webserver.cc:460] Webserver started at http://127.12.112.195:46639/ using document root <none> and password file <none>
I20260807 22:50:30.534075 29314 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:30.534165 29314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:30.534453 29314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:50:30.536374 29314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "4b04a53f567a472e9bdc07716dab3fd5"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "56a953989d3c42d2aeae606b5c5628fd"
server_key_iv: "df12191c2d59062383e3ec4468ccdbd1"
server_key_version: "encryptionkey@0"
I20260807 22:50:30.536929 29314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "4b04a53f567a472e9bdc07716dab3fd5"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "56a953989d3c42d2aeae606b5c5628fd"
server_key_iv: "df12191c2d59062383e3ec4468ccdbd1"
server_key_version: "encryptionkey@0"
I20260807 22:50:30.540390 29314 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 22:50:30.542641 29329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:30.543830 29314 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:50:30.543960 29314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "4b04a53f567a472e9bdc07716dab3fd5"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "56a953989d3c42d2aeae606b5c5628fd"
server_key_iv: "df12191c2d59062383e3ec4468ccdbd1"
server_key_version: "encryptionkey@0"
I20260807 22:50:30.544066 29314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:30.561550 29314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:30.564435 29314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:30.564626 29314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:30.565212 29314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:30.566007 29314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:30.566077 29314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:30.566146 29314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:30.566190 29314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:30.575183 29314 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:34655
I20260807 22:50:30.575222 29451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:34655 every 8 connection(s)
I20260807 22:50:30.576040 29314 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:50:30.583515 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 29314
I20260807 22:50:30.583647 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:50:30.583950 12739 external_mini_cluster.cc:1428] Setting key 7c8379b2b71668f884844a41767c02d7
Aug 07 22:50:30 dist-test-slave-tm1g krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143030, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:30.590369 29003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.578680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:47681 (local address 127.12.112.254:46073)
0807 22:50:30.578825 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:30.578829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:30.579728 (+ 899us) server_negotiation.cc:407] Connection header received
0807 22:50:30.580632 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:30.580635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:30.580696 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:30.580806 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:30.581913 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.582533 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.583713 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.584052 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.584171 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.587089 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:30.587092 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:30.587094 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:30.587116 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:30.588553 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:30.589087 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:30.589090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:30.589091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:30.589164 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:30.589467 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:30.589469 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:30.589470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:30.589628 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:30.589700 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:30.590114 (+ 414us) server_negotiation.cc:299] Negotiation successful
0807 22:50:30.590203 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:50:30.591130 29458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.578970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:47681)
0807 22:50:30.579586 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:30.579625 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:30.580434 (+ 809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:30.580977 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:30.580983 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:30.581324 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:30.581759 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.581781 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.582658 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.582662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.583568 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.583577 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.584200 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.584203 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.584398 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.585098 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:30.585113 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:30.586942 (+ 1829us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:30.588728 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:30.588732 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:30.588742 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:30.588996 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:30.589242 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:30.589244 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:30.589245 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:30.589388 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:30.589711 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:30.589715 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:30.589922 (+ 207us) client_negotiation.cc:769] Sending connection context
0807 22:50:30.590069 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 22:50:30.590296 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":107,"threads_started":1}
I20260807 22:50:30.592226 29455 heartbeater.cc:347] Connected to a master server at 127.12.112.254:46073
I20260807 22:50:30.592428 29455 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:30.592855 29455 heartbeater.cc:511] Master 127.12.112.254:46073 requested a full tablet report, sending...
I20260807 22:50:30.593770 28960 ts_manager.cc:194] Registered new tserver with Master: 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655)
I20260807 22:50:30.594300 28960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:47681
I20260807 22:50:30.597728 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:50:30.606258 29003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.599631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35346 (local address 127.12.112.254:46073)
0807 22:50:30.599742 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:30.599746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:30.599950 (+ 204us) server_negotiation.cc:407] Connection header received
0807 22:50:30.600041 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:30.600044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:30.600077 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:30.600140 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:30.600767 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.601240 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.601992 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.602187 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.602257 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.603504 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:30.603507 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:30.603509 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:30.603529 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:30.604879 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:30.605250 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:30.605265 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:30.605266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:30.605336 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:30.605613 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:30.605615 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:30.605616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:30.605800 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:30.605896 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:30.606075 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 22:50:30.606157 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:50:30.609057 28960 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:50:30.612540 28960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:50:30.626401 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.620544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:44315 (local address 127.0.0.1:38374)
0807 22:50:30.621274 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:30.621289 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:30.621418 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:30.622401 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:30.622404 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:30.622424 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:30.622538 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.622544 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.623670 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.623677 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.624860 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.624870 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.625817 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.625820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.625938 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.625978 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 22:50:30.626107 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 22:50:30.626227 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"mutex_wait_us":30,"thread_start_us":105,"threads_started":1}
I20260807 22:50:30.626410 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.621195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38374 (local address 127.12.112.194:44315)
0807 22:50:30.621919 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:30.621931 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:30.621949 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:50:30.622022 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:30.622027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:30.622206 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:30.622690 (+ 484us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:30.622845 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.623542 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.624983 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.625698 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.625826 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.625961 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:30.626136 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 22:50:30.626226 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":139,"threads_started":1}
I20260807 22:50:30.627243 29473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.621434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54220 (local address 127.12.112.195:34655)
0807 22:50:30.621795 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:30.621810 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:30.621935 (+ 125us) server_negotiation.cc:407] Connection header received
0807 22:50:30.622036 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:30.622040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:30.622205 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:30.622375 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:30.622749 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.623823 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.625499 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.626369 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.626490 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.626598 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:30.626928 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 22:50:30.627036 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":143,"threads_started":1}
I20260807 22:50:30.627100 29468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.620805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:34655 (local address 127.0.0.1:54220)
0807 22:50:30.621836 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:30.621851 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:30.621943 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:30.622529 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:30.622532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:30.622546 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:30.622633 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.622638 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.623996 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.624002 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.625348 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.625359 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.626666 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.626670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.626771 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.626795 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:50:30.626875 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:50:30.626954 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":954,"mutex_wait_us":58,"thread_start_us":81,"threads_started":1}
I20260807 22:50:30.627678 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.620423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40149 (local address 127.0.0.1:48760)
0807 22:50:30.620879 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:30.620924 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:30.621750 (+ 826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:30.622268 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:30.622273 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:30.622294 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:30.622464 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.622476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.624024 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.624027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.625351 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.625359 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.626699 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.626702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.626775 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.626797 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:50:30.627475 (+ 678us) client_negotiation.cc:240] Negotiation successful
0807 22:50:30.627557 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":57,"thread_start_us":98,"threads_started":1}
I20260807 22:50:30.627694 29471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.621090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48760 (local address 127.12.112.193:40149)
0807 22:50:30.621679 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:30.621693 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:30.621719 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:50:30.621926 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:30.621932 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:30.622120 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:30.622276 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:30.622579 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.623892 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.625499 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.626369 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.626490 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.626598 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:30.627458 (+ 860us) server_negotiation.cc:299] Negotiation successful
0807 22:50:30.627551 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":74,"threads_started":1}
I20260807 22:50:30.629879 29383 tablet_service.cc:1467] Processing CreateTablet for tablet 22b3b9383f7f4429882b88442f2c0045 (DEFAULT_TABLE table=test-table [id=41d6a83d013e4a74a9d25c76c39ff550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:30.629880 29235 tablet_service.cc:1467] Processing CreateTablet for tablet 22b3b9383f7f4429882b88442f2c0045 (DEFAULT_TABLE table=test-table [id=41d6a83d013e4a74a9d25c76c39ff550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:30.631047 29383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22b3b9383f7f4429882b88442f2c0045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:30.631367 29235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22b3b9383f7f4429882b88442f2c0045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:30.632617 29093 tablet_service.cc:1467] Processing CreateTablet for tablet 22b3b9383f7f4429882b88442f2c0045 (DEFAULT_TABLE table=test-table [id=41d6a83d013e4a74a9d25c76c39ff550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:30.633484 29093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22b3b9383f7f4429882b88442f2c0045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:30.638535 29476 tablet_bootstrap.cc:492] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: Bootstrap starting.
I20260807 22:50:30.639178 29474 tablet_bootstrap.cc:492] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: Bootstrap starting.
I20260807 22:50:30.639653 29477 tablet_bootstrap.cc:492] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Bootstrap starting.
I20260807 22:50:30.641505 29477 tablet_bootstrap.cc:654] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:30.641892 29474 tablet_bootstrap.cc:654] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:30.642647 29474 log.cc:824] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:30.642647 29477 log.cc:824] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:30.644464 29474 tablet_bootstrap.cc:492] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: No bootstrap required, opened a new log
I20260807 22:50:30.644659 29477 tablet_bootstrap.cc:492] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: No bootstrap required, opened a new log
I20260807 22:50:30.644668 29474 ts_tablet_manager.cc:1397] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:50:30.644830 29477 ts_tablet_manager.cc:1397] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:50:30.645538 29476 tablet_bootstrap.cc:654] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:30.646349 29476 log.cc:824] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:30.648337 29476 tablet_bootstrap.cc:492] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: No bootstrap required, opened a new log
I20260807 22:50:30.648523 29476 ts_tablet_manager.cc:1397] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260807 22:50:30.648314 29474 raft_consensus.cc:348] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:30.648615 29474 raft_consensus.cc:374] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:30.648672 29474 raft_consensus.cc:729] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83ee8adc4ef542198b471d659adcf0eb, State: Initialized, Role: FOLLOWER
I20260807 22:50:30.648778 29477 raft_consensus.cc:348] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:30.649022 29477 raft_consensus.cc:374] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:30.649088 29477 raft_consensus.cc:729] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96643797a37940c6b2178a4df4bc22b0, State: Initialized, Role: FOLLOWER
I20260807 22:50:30.649155 29474 consensus_queue.cc:260] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:30.649477 29477 consensus_queue.cc:260] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:30.649845 29307 heartbeater.cc:503] Master 127.12.112.254:46073 was elected leader, sending a full tablet report...
I20260807 22:50:30.650130 29474 ts_tablet_manager.cc:1428] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 22:50:30.650413 29477 ts_tablet_manager.cc:1428] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260807 22:50:30.650759 29164 heartbeater.cc:503] Master 127.12.112.254:46073 was elected leader, sending a full tablet report...
I20260807 22:50:30.652088 29476 raft_consensus.cc:348] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:30.652333 29476 raft_consensus.cc:374] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:30.652393 29476 raft_consensus.cc:729] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b04a53f567a472e9bdc07716dab3fd5, State: Initialized, Role: FOLLOWER
I20260807 22:50:30.652848 29476 consensus_queue.cc:260] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:30.653560 29455 heartbeater.cc:503] Master 127.12.112.254:46073 was elected leader, sending a full tablet report...
I20260807 22:50:30.653807 29476 ts_tablet_manager.cc:1428] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260807 22:50:30.654405 29165 tablet.cc:2369] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:50:30.716944 29481 raft_consensus.cc:482] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:50:30.717187 29481 raft_consensus.cc:504] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:30.718499 29481 leader_election.cc:288] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96643797a37940c6b2178a4df4bc22b0 (127.12.112.193:40149), 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655)
I20260807 22:50:30.722043 29473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.718856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:51875 (local address 127.12.112.195:34655)
0807 22:50:30.718981 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:30.718985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:30.718999 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:50:30.719151 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:30.719156 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:30.719203 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:30.719282 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:30.719568 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.720074 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.721088 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.721494 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.721621 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.721671 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:30.721854 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 22:50:30.721922 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:50:30.722043 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.718717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:34655 (local address 127.12.112.194:51875)
0807 22:50:30.718902 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:30.718929 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:30.719018 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:30.719304 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:30.719307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:30.719326 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:30.719450 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.719455 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.720181 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.720187 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.720957 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.720965 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.721612 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.721616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.721723 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.721747 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:50:30.721835 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:50:30.721905 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260807 22:50:30.722465 29471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.718934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:34281 (local address 127.12.112.193:40149)
0807 22:50:30.719059 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:30.719064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:30.719474 (+ 410us) server_negotiation.cc:407] Connection header received
0807 22:50:30.719617 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:30.719620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:30.719671 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:30.719757 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:30.720013 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.720508 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.721503 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.721894 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.722017 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.722063 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:30.722267 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 22:50:30.722362 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:50:30.722483 29484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.718719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40149 (local address 127.12.112.194:34281)
0807 22:50:30.719383 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:30.719395 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:30.719509 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:30.719763 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:30.719766 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:30.719781 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:30.719907 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.719912 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.720617 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.720622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.721385 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:30.721393 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.722011 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.722014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:30.722109 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.722132 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:50:30.722247 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 22:50:30.722337 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"mutex_wait_us":300,"thread_start_us":163,"threads_started":1}
I20260807 22:50:30.722769 29404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22b3b9383f7f4429882b88442f2c0045" candidate_uuid: "83ee8adc4ef542198b471d659adcf0eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b04a53f567a472e9bdc07716dab3fd5" is_pre_election: true
I20260807 22:50:30.723089 29404 raft_consensus.cc:2454] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83ee8adc4ef542198b471d659adcf0eb in term 0.
I20260807 22:50:30.723076 29114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22b3b9383f7f4429882b88442f2c0045" candidate_uuid: "83ee8adc4ef542198b471d659adcf0eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96643797a37940c6b2178a4df4bc22b0" is_pre_election: true
I20260807 22:50:30.723381 29114 raft_consensus.cc:2454] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83ee8adc4ef542198b471d659adcf0eb in term 0.
I20260807 22:50:30.723603 29189 leader_election.cc:302] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b04a53f567a472e9bdc07716dab3fd5, 83ee8adc4ef542198b471d659adcf0eb; no voters:
I20260807 22:50:30.723852 29481 raft_consensus.cc:2781] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:50:30.723959 29481 raft_consensus.cc:482] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:50:30.724018 29481 raft_consensus.cc:3037] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:30.725092 29481 raft_consensus.cc:504] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:30.725487 29481 leader_election.cc:288] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [CANDIDATE]: Term 1 election: Requested vote from peers 96643797a37940c6b2178a4df4bc22b0 (127.12.112.193:40149), 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655)
I20260807 22:50:30.725806 29114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22b3b9383f7f4429882b88442f2c0045" candidate_uuid: "83ee8adc4ef542198b471d659adcf0eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96643797a37940c6b2178a4df4bc22b0"
I20260807 22:50:30.725899 29404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22b3b9383f7f4429882b88442f2c0045" candidate_uuid: "83ee8adc4ef542198b471d659adcf0eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b04a53f567a472e9bdc07716dab3fd5"
I20260807 22:50:30.725981 29114 raft_consensus.cc:3037] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:30.726034 29404 raft_consensus.cc:3037] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:30.727105 29114 raft_consensus.cc:2454] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83ee8adc4ef542198b471d659adcf0eb in term 1.
I20260807 22:50:30.727253 29404 raft_consensus.cc:2454] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83ee8adc4ef542198b471d659adcf0eb in term 1.
I20260807 22:50:30.727398 29190 leader_election.cc:302] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83ee8adc4ef542198b471d659adcf0eb, 96643797a37940c6b2178a4df4bc22b0; no voters:
I20260807 22:50:30.727576 29481 raft_consensus.cc:2781] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:50:30.727828 29481 raft_consensus.cc:686] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 1 LEADER]: Becoming Leader. State: Replica: 83ee8adc4ef542198b471d659adcf0eb, State: Running, Role: LEADER
I20260807 22:50:30.728163 29481 consensus_queue.cc:237] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:30.731207 28960 catalog_manager.cc:5495] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194). New cstate: current_term: 1 leader_uuid: "83ee8adc4ef542198b471d659adcf0eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } health_report { overall_health: UNKNOWN } } }
I20260807 22:50:30.750399 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.747120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38384 (local address 127.12.112.194:44315)
0807 22:50:30.747252 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:30.747255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:30.747268 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:50:30.747366 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:30.747369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:30.747429 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:30.747528 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:50:30.747788 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.748320 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.749123 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:30.749323 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:30.749399 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:30.749655 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:50:30.750041 (+ 386us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:50:30.750129 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:30.750186 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 22:50:30.750232 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:50:30.756052 29114 raft_consensus.cc:1261] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Refusing update from remote peer 83ee8adc4ef542198b471d659adcf0eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:30.756069 29404 raft_consensus.cc:1261] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5 [term 1 FOLLOWER]: Refusing update from remote peer 83ee8adc4ef542198b471d659adcf0eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:30.756765 29485 consensus_queue.cc:1035] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:30.756955 29481 consensus_queue.cc:1035] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:30.764216 29491 mvcc.cc:205] Tried to move back new op lower bound from 7316041853970006016 to 7316041853864976384. Current Snapshot: MvccSnapshot[applied={T|T < 7316041853970006016}]
I20260807 22:50:30.772960 28959 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:50:30.773147 28959 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:50:30.775573 28959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Sending DeleteTablet for 3 replicas of tablet 22b3b9383f7f4429882b88442f2c0045
I20260807 22:50:30.776330 29093 tablet_service.cc:1514] Processing DeleteTablet for tablet 22b3b9383f7f4429882b88442f2c0045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:30 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:48760
I20260807 22:50:30.776510 29235 tablet_service.cc:1514] Processing DeleteTablet for tablet 22b3b9383f7f4429882b88442f2c0045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:30 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:38374
I20260807 22:50:30.776605 29383 tablet_service.cc:1514] Processing DeleteTablet for tablet 22b3b9383f7f4429882b88442f2c0045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:30 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:54220
I20260807 22:50:30.776906 29501 tablet_replica.cc:330] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: stopping tablet replica
I20260807 22:50:30.777103 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 29027
I20260807 22:50:30.777165 29502 tablet_replica.cc:330] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: stopping tablet replica
I20260807 22:50:30.777257 29501 raft_consensus.cc:2229] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:50:30.777447 29502 raft_consensus.cc:2229] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:50:30.777737 29502 raft_consensus.cc:2258] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:30.777995 29501 raft_consensus.cc:2258] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:30.779464 29502 ts_tablet_manager.cc:1905] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:30.779547 29501 ts_tablet_manager.cc:1905] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:30.782233 29502 ts_tablet_manager.cc:1918] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:30.782352 29502 log.cc:1196] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/22b3b9383f7f4429882b88442f2c0045
I20260807 22:50:30.782684 29502 ts_tablet_manager.cc:1939] T 22b3b9383f7f4429882b88442f2c0045 P 4b04a53f567a472e9bdc07716dab3fd5: Deleting consensus metadata
I20260807 22:50:30.783002 29501 ts_tablet_manager.cc:1918] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:30.783106 29501 log.cc:1196] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/22b3b9383f7f4429882b88442f2c0045
I20260807 22:50:30.783465 29501 ts_tablet_manager.cc:1939] T 22b3b9383f7f4429882b88442f2c0045 P 83ee8adc4ef542198b471d659adcf0eb: Deleting consensus metadata
I20260807 22:50:30.783972 28946 catalog_manager.cc:4841] TS 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655): tablet 22b3b9383f7f4429882b88442f2c0045 (table test-table [id=41d6a83d013e4a74a9d25c76c39ff550]) successfully deleted
I20260807 22:50:30.784583 28945 catalog_manager.cc:4841] TS 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315): tablet 22b3b9383f7f4429882b88442f2c0045 (table test-table [id=41d6a83d013e4a74a9d25c76c39ff550]) successfully deleted
I20260807 22:50:30.788733 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 29169
W20260807 22:50:30.788703 28947 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:40149 (error 108)
I20260807 22:50:30.792392 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:30.792042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40149 (local address 127.0.0.1:48766)
0807 22:50:30.792199 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:30.792284 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:40149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 22:50:30.792584 28947 catalog_manager.cc:4584] TS 96643797a37940c6b2178a4df4bc22b0 (127.12.112.193:40149): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 22b3b9383f7f4429882b88442f2c0045: Network error: Client connection negotiation failed: client connection to 127.12.112.193:40149: connect: Connection refused (error 111)
I20260807 22:50:30.797104 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 29314
I20260807 22:50:30.803797 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 28926
I20260807 22:50:50.812060 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:46073
--webserver_interface=127.12.112.254
--webserver_port=41917
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:46073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:50:50.921674 29504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:50.921929 29504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:50.921968 29504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:50.925946 29504 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 22:50:50.925992 29504 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 22:50:50.926008 29504 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 22:50:50.926021 29504 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:50:50.926039 29504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:50.926098 29504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:50.926123 29504 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:50:50.926155 29504 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:50:50.931314 29504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:46073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:46073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=41917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:50.932281 29504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:50.933277 29504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:50:50.946679 29504 server_base.cc:1034] running on GCE node
W20260807 22:50:50.946655 29513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:50.946930 29515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:50.946645 29512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:50.947540 29504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:50.948648 29504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:50.949806 29504 hybrid_clock.cc:648] HybridClock initialized: now 1786143050949794 us; error 26 us; skew 500 ppm
Aug 07 22:50:50 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143050, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:50.952682 29504 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:50:50.953486 29504 webserver.cc:460] Webserver started at http://127.12.112.254:41917/ using document root <none> and password file <none>
I20260807 22:50:50.954005 29504 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:50.954077 29504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:50.957746 29504 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:50:50.959896 29523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:50.961167 29504 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:50:50.961266 29504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "26076d742dc9419da95c5b90a9b0174a"
format_stamp: "Formatted at 2026-08-07 22:50:29 on dist-test-slave-tm1g"
server_key: "fccd38aac35c5bc2b9cb0cb5a3845df8"
server_key_iv: "fe96851cdfed35076179fc844291d75b"
server_key_version: "encryptionkey@0"
I20260807 22:50:50.961822 29504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:50.979533 29504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:50.982260 29504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:50.982470 29504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:50.989400 29504 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:46073
I20260807 22:50:50.989693 29583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:46073 every 8 connection(s)
I20260807 22:50:50.990536 29504 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:50:50.994760 29584 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:50:50.996337 29584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Bootstrap starting.
I20260807 22:50:50.999354 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 29504
I20260807 22:50:50.999801 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:40149
--local_ip_for_outbound_sockets=127.12.112.193
--tserver_master_addrs=127.12.112.254:46073
--webserver_port=33845
--webserver_interface=127.12.112.193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:50:51.014551 29584 log.cc:824] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:51.023272 29584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:50:51.023649 29584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Bootstrap complete.
I20260807 22:50:51.027832 29584 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:50:51.028266 29584 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26076d742dc9419da95c5b90a9b0174a, State: Initialized, Role: FOLLOWER
I20260807 22:50:51.028790 29584 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:50:51.028937 29584 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:50:51.029031 29584 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:50:51.029150 29584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:50:51.031105 29584 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:50:51.031438 29584 leader_election.cc:302] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26076d742dc9419da95c5b90a9b0174a; no voters:
I20260807 22:50:51.031769 29584 leader_election.cc:288] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:50:51.031864 29589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:50:51.032074 29589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 2 LEADER]: Becoming Leader. State: Replica: 26076d742dc9419da95c5b90a9b0174a, State: Running, Role: LEADER
I20260807 22:50:51.032425 29589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:50:51.033077 29584 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:50:51.033484 29589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26076d742dc9419da95c5b90a9b0174a. Latest consensus state: current_term: 2 leader_uuid: "26076d742dc9419da95c5b90a9b0174a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } } }
I20260807 22:50:51.033589 29589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:51.033874 29590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "26076d742dc9419da95c5b90a9b0174a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } } }
I20260807 22:50:51.033987 29590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: This master's current role is: LEADER
I20260807 22:50:51.034334 29593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:50:51.039201 29593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:50:51.040023 29593 catalog_manager.cc:1259] Loaded cluster ID: aaae44fb66574199835b08d757fb6798
I20260807 22:50:51.040087 29593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:50:51.042586 29593 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:50:51.043267 29593 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Loaded TSK: 0
I20260807 22:50:51.060103 29593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Generated new TSK 1
I20260807 22:50:51.060359 29593 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:50:51.120287 29587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:51.120532 29587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:51.120575 29587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:51.124622 29587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:51.124676 29587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:51.124755 29587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:50:51.129909 29587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:40149
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=33845
--tserver_master_addrs=127.12.112.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:51.130903 29587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:51.131888 29587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:51.141566 29615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:51.141561 29614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:51.141669 29617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:51.141913 29587 server_base.cc:1034] running on GCE node
I20260807 22:50:51.142470 29587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:51.143191 29587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:51.144372 29587 hybrid_clock.cc:648] HybridClock initialized: now 1786143051144354 us; error 35 us; skew 500 ppm
Aug 07 22:50:51 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143051, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:51.147266 29587 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:50:51.148331 29587 webserver.cc:460] Webserver started at http://127.12.112.193:33845/ using document root <none> and password file <none>
I20260807 22:50:51.149039 29587 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:51.149153 29587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:51.154176 29587 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:50:51.156850 29625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:51.158512 29587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:50:51.158631 29587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "96643797a37940c6b2178a4df4bc22b0"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "6927d6c8f5998ec66afc2a502821f1a9"
server_key_iv: "36abdc30695fec0266f3869a88a2928d"
server_key_version: "encryptionkey@0"
I20260807 22:50:51.159310 29587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:51.189917 29587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:51.192853 29587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:51.193009 29587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:51.193543 29587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:51.194571 29633 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:50:51.198602 29587 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:50:51.198680 29587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260807 22:50:51.198750 29587 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:50:51.200316 29587 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:50:51.200398 29587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 22:50:51.200718 29633 tablet_bootstrap.cc:492] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Bootstrap starting.
I20260807 22:50:51.210937 29587 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:40149
I20260807 22:50:51.211014 29749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:40149 every 8 connection(s)
I20260807 22:50:51.211870 29587 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:50:51.218053 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 29587
I20260807 22:50:51.218582 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:44315
--local_ip_for_outbound_sockets=127.12.112.194
--tserver_master_addrs=127.12.112.254:46073
--webserver_port=36137
--webserver_interface=127.12.112.194
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:50:51.218829 29633 log.cc:824] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:50:51 dist-test-slave-tm1g krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143051, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:51.226768 29633 tablet_bootstrap.cc:492] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:50:51.227156 29633 tablet_bootstrap.cc:492] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Bootstrap complete.
I20260807 22:50:51.228549 29633 ts_tablet_manager.cc:1397] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.015s
I20260807 22:50:51.230472 29753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.213903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:53319)
0807 22:50:51.214456 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:51.214498 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:51.215286 (+ 788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:51.216327 (+ 1041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:51.216337 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:51.216758 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:51.217201 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.217214 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.219015 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.219018 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.220120 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.220130 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.221324 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.221328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.221533 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.222213 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:51.222234 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:51.224056 (+ 1822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:51.226949 (+ 2893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:51.226958 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:51.226971 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:51.227365 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:51.227804 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:51.227808 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:51.227812 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:51.228009 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:51.228771 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:51.228777 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:51.229047 (+ 270us) client_negotiation.cc:769] Sending connection context
0807 22:50:51.229238 (+ 191us) client_negotiation.cc:240] Negotiation successful
0807 22:50:51.229542 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":179,"threads_started":1}
I20260807 22:50:51.231070 29752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.213864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:53319 (local address 127.12.112.254:46073)
0807 22:50:51.214238 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.214259 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.214618 (+ 359us) server_negotiation.cc:407] Connection header received
0807 22:50:51.215682 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.215692 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.215966 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.216277 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:51.217386 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.218823 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.220268 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.220946 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.221086 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.224274 (+ 3188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:51.224284 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:51.224304 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:51.224348 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:51.226787 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.227516 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.227524 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.227533 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.227687 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.228121 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.228128 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.228133 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.228580 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:51.228711 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.229415 (+ 704us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.229745 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":138,"threads_started":1}
I20260807 22:50:51.231431 29633 raft_consensus.cc:348] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:51.231841 29633 raft_consensus.cc:729] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96643797a37940c6b2178a4df4bc22b0, State: Initialized, Role: FOLLOWER
I20260807 22:50:51.232398 29633 consensus_queue.cc:260] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } }
I20260807 22:50:51.233407 29750 heartbeater.cc:347] Connected to a master server at 127.12.112.254:46073
I20260807 22:50:51.233493 29633 ts_tablet_manager.cc:1428] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s
I20260807 22:50:51.233651 29750 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:51.234218 29750 heartbeater.cc:511] Master 127.12.112.254:46073 requested a full tablet report, sending...
I20260807 22:50:51.236518 29544 ts_manager.cc:194] Registered new tserver with Master: 96643797a37940c6b2178a4df4bc22b0 (127.12.112.193:40149)
I20260807 22:50:51.240029 29544 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:53319
I20260807 22:50:51.242270 29750 heartbeater.cc:503] Master 127.12.112.254:46073 was elected leader, sending a full tablet report...
Aug 07 22:50:51 dist-test-slave-tm1g krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143050, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.193@KRBTEST.COM
I20260807 22:50:51.250566 29757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.239207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40149 (local address 127.0.0.1:54360)
0807 22:50:51.239584 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:51.239625 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:51.239741 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:51.240347 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:51.240352 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:51.240756 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:51.240879 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.240888 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.242341 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.242344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.243167 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.243179 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.243864 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.243868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.243963 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.244537 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:51.244549 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:51.245844 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:51.248788 (+ 2944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:51.248799 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:51.248804 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:51.249044 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:51.249348 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:51.249352 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:51.249354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:51.249438 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:51.249882 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:51.249887 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:51.250005 (+ 118us) client_negotiation.cc:769] Sending connection context
0807 22:50:51.250141 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 22:50:51.250397 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":100,"threads_started":1}
I20260807 22:50:51.250566 29758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.239289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54360 (local address 127.12.112.193:40149)
0807 22:50:51.239903 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.239914 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.239936 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:50:51.239996 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.240003 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.240190 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.240318 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:51.241003 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.242185 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.243336 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.243647 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.243772 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.245975 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:51.245985 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:51.245996 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:51.246025 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:51.248676 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.249157 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.249163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.249165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.249251 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.249529 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.249534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.249536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.249758 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:51.249903 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.250219 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.250396 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":525,"thread_start_us":115,"threads_started":1}
I20260807 22:50:51.251479 29677 tablet_service.cc:1514] Processing DeleteTablet for tablet 22b3b9383f7f4429882b88442f2c0045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:30 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:54360
I20260807 22:50:51.252408 29759 tablet_replica.cc:330] stopping tablet replica
I20260807 22:50:51.252692 29759 raft_consensus.cc:2229] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:50:51.252936 29759 raft_consensus.cc:2258] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:51.253906 29759 ts_tablet_manager.cc:1905] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:51.257508 29759 ts_tablet_manager.cc:1918] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:51.257629 29759 log.cc:1196] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal/wals/22b3b9383f7f4429882b88442f2c0045
I20260807 22:50:51.257916 29759 ts_tablet_manager.cc:1939] T 22b3b9383f7f4429882b88442f2c0045 P 96643797a37940c6b2178a4df4bc22b0: Deleting consensus metadata
I20260807 22:50:51.259629 29527 catalog_manager.cc:4841] TS 96643797a37940c6b2178a4df4bc22b0 (127.12.112.193:40149): tablet 22b3b9383f7f4429882b88442f2c0045 (table test-table [id=41d6a83d013e4a74a9d25c76c39ff550]) successfully deleted
W20260807 22:50:51.335465 29755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:51.335701 29755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:51.335767 29755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:51.340013 29755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:51.340072 29755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:51.340158 29755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:50:51.345376 29755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:44315
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=36137
--tserver_master_addrs=127.12.112.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:51.346480 29755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:51.347481 29755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:51.357345 29766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:51.357343 29767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:51.357527 29770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:51.357607 29755 server_base.cc:1034] running on GCE node
I20260807 22:50:51.358031 29755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:51.358721 29755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:51.359889 29755 hybrid_clock.cc:648] HybridClock initialized: now 1786143051359877 us; error 27 us; skew 500 ppm
Aug 07 22:50:51 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143051, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:51.362592 29755 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:50:51.363461 29755 webserver.cc:460] Webserver started at http://127.12.112.194:36137/ using document root <none> and password file <none>
I20260807 22:50:51.364094 29755 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:51.364205 29755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:51.368420 29755 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:50:51.370565 29777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:51.371835 29755 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:51.371982 29755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "83ee8adc4ef542198b471d659adcf0eb"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "b2b665ad0176d0ecf3c96ceb0e95c5d4"
server_key_iv: "26b90758501a7cd85afa4fd8bdb0978b"
server_key_version: "encryptionkey@0"
I20260807 22:50:51.372546 29755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:51.389694 29755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:51.392788 29755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:51.393010 29755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:51.393612 29755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:51.394510 29755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:51.394577 29755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:51.394649 29755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:51.394699 29755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:51.404031 29755 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:44315
I20260807 22:50:51.404060 29901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:44315 every 8 connection(s)
I20260807 22:50:51.405022 29755 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:50:51.405884 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 29755
I20260807 22:50:51.406371 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:34655
--local_ip_for_outbound_sockets=127.12.112.195
--tserver_master_addrs=127.12.112.254:46073
--webserver_port=46639
--webserver_interface=127.12.112.195
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:50:51 dist-test-slave-tm1g krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143051, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:51.420961 29752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.406916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:53523 (local address 127.12.112.254:46073)
0807 22:50:51.407098 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.407105 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.408322 (+ 1217us) server_negotiation.cc:407] Connection header received
0807 22:50:51.409206 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.409211 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.409278 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.409386 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:51.411039 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.411692 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.413644 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.413892 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.413986 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.417206 (+ 3220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:51.417218 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:51.417221 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:51.417247 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:51.418818 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.419393 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.419395 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.419397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.419474 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.419855 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.419857 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.419858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.420049 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:51.420127 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.420716 (+ 589us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.420832 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:50:51.422024 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.407323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:53523)
0807 22:50:51.408118 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:51.408183 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:51.408994 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:51.409598 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:51.409609 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:51.410125 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:51.410853 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.410876 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.411842 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.411848 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.413487 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.413503 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.414068 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.414075 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.414358 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.415037 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:51.415063 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:51.417008 (+ 1945us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:51.418937 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:51.418943 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:51.418958 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:51.419286 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:51.419559 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:51.419562 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:51.419564 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:51.419733 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:51.420149 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:51.420156 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:51.420463 (+ 307us) client_negotiation.cc:769] Sending connection context
0807 22:50:51.420665 (+ 202us) client_negotiation.cc:240] Negotiation successful
0807 22:50:51.420991 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":115,"threads_started":1}
I20260807 22:50:51.423348 29903 heartbeater.cc:347] Connected to a master server at 127.12.112.254:46073
I20260807 22:50:51.423601 29903 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:51.424104 29903 heartbeater.cc:511] Master 127.12.112.254:46073 requested a full tablet report, sending...
I20260807 22:50:51.425225 29544 ts_manager.cc:194] Registered new tserver with Master: 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315)
I20260807 22:50:51.426007 29544 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:53523
W20260807 22:50:51.521246 29907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:50:51.521495 29907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:50:51.521539 29907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:50:51.525493 29907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:50:51.525547 29907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:50:51.525602 29907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:50:51.530710 29907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:34655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=46639
--tserver_master_addrs=127.12.112.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:50:51.531679 29907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:50:51.532675 29907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:50:51.542284 29913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:50:51.542268 29914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:51.542464 29907 server_base.cc:1034] running on GCE node
W20260807 22:50:51.542644 29916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:50:51.543061 29907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:50:51.543697 29907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:50:51.544850 29907 hybrid_clock.cc:648] HybridClock initialized: now 1786143051544824 us; error 43 us; skew 500 ppm
Aug 07 22:50:51 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143051, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:50:51.547633 29907 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:50:51.548410 29907 webserver.cc:460] Webserver started at http://127.12.112.195:46639/ using document root <none> and password file <none>
I20260807 22:50:51.548967 29907 fs_manager.cc:359] Metadata directory not provided
I20260807 22:50:51.549041 29907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:50:51.552739 29907 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:50:51.554925 29924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:51.556066 29907 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:50:51.556180 29907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "4b04a53f567a472e9bdc07716dab3fd5"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "56a953989d3c42d2aeae606b5c5628fd"
server_key_iv: "df12191c2d59062383e3ec4468ccdbd1"
server_key_version: "encryptionkey@0"
I20260807 22:50:51.556706 29907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:50:51.568825 29907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:50:51.571935 29907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:50:51.572134 29907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:50:51.572714 29907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:50:51.573519 29907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:50:51.573565 29907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:51.573602 29907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:50:51.573657 29907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:50:51.583014 29907 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:34655
I20260807 22:50:51.583045 30052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:34655 every 8 connection(s)
I20260807 22:50:51.583979 29907 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:50:51 dist-test-slave-tm1g krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143051, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:50:51.594175 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 29907
I20260807 22:50:51.597317 29752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.585724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:59027 (local address 127.12.112.254:46073)
0807 22:50:51.585868 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.585872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.586916 (+ 1044us) server_negotiation.cc:407] Connection header received
0807 22:50:51.587826 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.587830 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.587891 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.587992 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:51.589106 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.589635 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.590801 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.591024 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.591138 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.593548 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:51.593552 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:51.593554 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:51.593576 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:51.595155 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.595780 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.595783 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.595784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.595859 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.596259 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.596261 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.596262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.596432 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:51.596544 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.597020 (+ 476us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.597131 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 22:50:51.598186 30056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.586077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:59027)
0807 22:50:51.586769 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:51.586811 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:51.587618 (+ 807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:51.588160 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:51.588166 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:51.588515 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:50:51.588957 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.588970 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.589760 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.589764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.590665 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.590675 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.591176 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.591180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.591355 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.591931 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:50:51.591947 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:50:51.593380 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:50:51.595295 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:51.595304 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:51.595320 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:51.595678 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:51.595965 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:50:51.595969 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:50:51.595973 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:50:51.596162 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:50:51.596559 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:50:51.596565 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:50:51.596783 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 22:50:51.596938 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 22:50:51.597174 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":116,"threads_started":1}
I20260807 22:50:51.599611 30054 heartbeater.cc:347] Connected to a master server at 127.12.112.254:46073
I20260807 22:50:51.599871 30054 heartbeater.cc:464] Registering TS with master...
I20260807 22:50:51.600507 30054 heartbeater.cc:511] Master 127.12.112.254:46073 requested a full tablet report, sending...
I20260807 22:50:51.601707 29544 ts_manager.cc:194] Registered new tserver with Master: 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655)
I20260807 22:50:51.602506 29544 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:59027
I20260807 22:50:51.603746 30059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.594936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44096 (local address 127.12.112.254:46073)
0807 22:50:51.595200 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.595205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.595361 (+ 156us) server_negotiation.cc:407] Connection header received
0807 22:50:51.595504 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.595506 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.595546 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.595616 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:51.596528 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.597134 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.598377 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.598718 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.598828 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.600434 (+ 1606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:51.600437 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:51.600439 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:51.600460 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:51.602103 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.602546 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.602549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.602551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.602642 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.602959 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.602963 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.602965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.603169 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:51.603315 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.603512 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.603602 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":97,"threads_started":1}
I20260807 22:50:51.605347 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:50:51.608886 30059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.605882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44100 (local address 127.12.112.254:46073)
0807 22:50:51.606007 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.606010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.606235 (+ 225us) server_negotiation.cc:407] Connection header received
0807 22:50:51.606389 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.606392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.606485 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.606563 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:50:51.606729 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.607191 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.607963 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.608177 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.608255 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.608496 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:50:51.608606 (+ 110us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 22:50:51.608802 (+ 196us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44100: token expired
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 22:50:51.608971 30059 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44100: token expired
W20260807 22:50:51.609344 29462 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.112.254:46073)
I20260807 22:50:51.615967 30059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.609644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44102 (local address 127.12.112.254:46073)
0807 22:50:51.609753 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.609756 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.609767 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:50:51.609846 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.609848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.609878 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.609939 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:50:51.610538 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.610994 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.611706 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.611902 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.611971 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.613114 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:50:51.613117 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:50:51.613119 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:50:51.613140 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:50:51.614562 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.614925 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.614928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.614929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.614998 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:50:51.615249 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:50:51.615253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:50:51.615254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:50:51.615426 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:50:51.615538 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.615774 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.615867 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:50:51.618467 29544 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:50:51.621698 29544 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:50:51.629375 29677 tablet_service.cc:1467] Processing CreateTablet for tablet 7fa062245de54480afa8ea0b67369a6c (DEFAULT_TABLE table=test-table [id=5cad09936b104d408849bd8a0a47fc87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:51.630125 29677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fa062245de54480afa8ea0b67369a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:51.633219 29633 tablet_bootstrap.cc:492] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Bootstrap starting.
I20260807 22:50:51.633703 29757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.628291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:34655 (local address 127.0.0.1:36628)
0807 22:50:51.628496 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:51.628508 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:51.628601 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:51.629412 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:51.629415 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:51.629435 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:51.629540 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.629549 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.631270 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.631273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.632131 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.632141 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.633218 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.633222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.633323 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.633383 (+ 60us) client_negotiation.cc:769] Sending connection context
0807 22:50:51.633454 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 22:50:51.633530 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260807 22:50:51.634034 30065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.628506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36628 (local address 127.12.112.195:34655)
0807 22:50:51.628878 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.628891 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.628915 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:50:51.628997 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.629003 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.629221 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.629701 (+ 480us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:51.629881 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.631146 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.632258 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.633090 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.633233 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.633471 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.633530 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.633635 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":166,"threads_started":1}
I20260807 22:50:51.634225 29633 tablet_bootstrap.cc:654] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:51.634683 30066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.628765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:44315 (local address 127.0.0.1:38986)
0807 22:50:51.629057 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:51.629071 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:51.629158 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:51.629914 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:51.629917 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:51.629935 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:51.630044 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.630052 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.631420 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.631424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.632525 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.632536 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.634322 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.634327 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.634427 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.634451 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:50:51.634500 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 22:50:51.634563 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":82,"threads_started":1}
I20260807 22:50:51.635394 30067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.629103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38986 (local address 127.12.112.194:44315)
0807 22:50:51.629466 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.629476 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.629496 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:50:51.629581 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.629588 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.629772 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.629933 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:51.630223 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.631299 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.632656 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.634157 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.634979 (+ 822us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.635105 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.635154 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.635239 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":143,"threads_started":1}
I20260807 22:50:51.635954 29633 tablet_bootstrap.cc:492] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: No bootstrap required, opened a new log
I20260807 22:50:51.636060 29633 ts_tablet_manager.cc:1397] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:50:51.636444 29633 raft_consensus.cc:348] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:50:51.636580 29633 raft_consensus.cc:374] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:51.636626 29633 raft_consensus.cc:729] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96643797a37940c6b2178a4df4bc22b0, State: Initialized, Role: FOLLOWER
I20260807 22:50:51.636771 29633 consensus_queue.cc:260] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:50:51.637542 29633 ts_tablet_manager.cc:1428] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:50:51.637131 29979 tablet_service.cc:1467] Processing CreateTablet for tablet 7fa062245de54480afa8ea0b67369a6c (DEFAULT_TABLE table=test-table [id=5cad09936b104d408849bd8a0a47fc87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:51.638252 29979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fa062245de54480afa8ea0b67369a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:51.638969 29829 tablet_service.cc:1467] Processing CreateTablet for tablet 7fa062245de54480afa8ea0b67369a6c (DEFAULT_TABLE table=test-table [id=5cad09936b104d408849bd8a0a47fc87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:50:51.639950 29829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fa062245de54480afa8ea0b67369a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:50:51.646746 30070 tablet_bootstrap.cc:492] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: Bootstrap starting.
I20260807 22:50:51.647447 30071 tablet_bootstrap.cc:492] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: Bootstrap starting.
I20260807 22:50:51.649194 30070 tablet_bootstrap.cc:654] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:51.649485 30071 tablet_bootstrap.cc:654] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: Neither blocks nor log segments found. Creating new log.
I20260807 22:50:51.649963 30070 log.cc:824] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:51.650166 30071 log.cc:824] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: Log is configured to *not* fsync() on all Append() calls
I20260807 22:50:51.652040 30071 tablet_bootstrap.cc:492] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: No bootstrap required, opened a new log
I20260807 22:50:51.652051 30070 tablet_bootstrap.cc:492] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: No bootstrap required, opened a new log
I20260807 22:50:51.652232 30071 ts_tablet_manager.cc:1397] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 22:50:51.652236 30070 ts_tablet_manager.cc:1397] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 22:50:51.655025 30070 raft_consensus.cc:348] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:50:51.655025 30071 raft_consensus.cc:348] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:50:51.655268 30070 raft_consensus.cc:374] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:51.655261 30071 raft_consensus.cc:374] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:50:51.655331 30070 raft_consensus.cc:729] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b04a53f567a472e9bdc07716dab3fd5, State: Initialized, Role: FOLLOWER
I20260807 22:50:51.655336 30071 raft_consensus.cc:729] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83ee8adc4ef542198b471d659adcf0eb, State: Initialized, Role: FOLLOWER
I20260807 22:50:51.655752 30070 consensus_queue.cc:260] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:50:51.655721 30071 consensus_queue.cc:260] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:50:51.656430 29903 heartbeater.cc:503] Master 127.12.112.254:46073 was elected leader, sending a full tablet report...
I20260807 22:50:51.656764 30071 ts_tablet_manager.cc:1428] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260807 22:50:51.656878 30070 ts_tablet_manager.cc:1428] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260807 22:50:51.657199 30054 heartbeater.cc:503] Master 127.12.112.254:46073 was elected leader, sending a full tablet report...
W20260807 22:50:51.713151 29751 tablet.cc:2369] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:50:51.795274 30074 raft_consensus.cc:482] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:50:51.795503 30074 raft_consensus.cc:504] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:50:51.796747 30074 leader_election.cc:288] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655), 96643797a37940c6b2178a4df4bc22b0 (127.12.112.193:40149)
I20260807 22:50:51.800709 30065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.797104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:44181 (local address 127.12.112.195:34655)
0807 22:50:51.797279 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.797285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.797466 (+ 181us) server_negotiation.cc:407] Connection header received
0807 22:50:51.797624 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.797627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.797676 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.797761 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:51.798025 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.798622 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.799741 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.800146 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.800287 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.800342 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.800522 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.800589 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 22:50:51.800709 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.796959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:34655 (local address 127.12.112.194:44181)
0807 22:50:51.797360 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:51.797387 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:51.797510 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:51.797773 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:51.797776 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:51.797791 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:51.797916 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.797922 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.798735 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.798740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.799619 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.799628 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.800281 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.800284 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.800401 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.800419 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 22:50:51.800503 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 22:50:51.800573 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":43}
I20260807 22:50:51.800967 30077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.797045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40149 (local address 127.12.112.194:54337)
0807 22:50:51.797458 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:51.797473 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:50:51.797586 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:50:51.797895 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:50:51.797898 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:50:51.797914 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:50:51.798052 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.798058 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.798907 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.798912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.799862 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:50:51.799871 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.800545 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.800549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:50:51.800640 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.800661 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:50:51.800722 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 22:50:51.800788 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":3,"thread_start_us":154,"threads_started":1}
I20260807 22:50:51.801103 30078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.797159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:54337 (local address 127.12.112.193:40149)
0807 22:50:51.797474 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.797481 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.797539 (+ 58us) server_negotiation.cc:407] Connection header received
0807 22:50:51.797701 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.797704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.797768 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.797883 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:50:51.798165 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.798794 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.799977 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.800423 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.800554 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.800711 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.800749 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.800955 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":62,"threads_started":1}
I20260807 22:50:51.801352 30003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fa062245de54480afa8ea0b67369a6c" candidate_uuid: "83ee8adc4ef542198b471d659adcf0eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b04a53f567a472e9bdc07716dab3fd5" is_pre_election: true
I20260807 22:50:51.801693 30003 raft_consensus.cc:2454] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83ee8adc4ef542198b471d659adcf0eb in term 0.
I20260807 22:50:51.801788 29701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fa062245de54480afa8ea0b67369a6c" candidate_uuid: "83ee8adc4ef542198b471d659adcf0eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96643797a37940c6b2178a4df4bc22b0" is_pre_election: true
I20260807 22:50:51.802059 29701 raft_consensus.cc:2454] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83ee8adc4ef542198b471d659adcf0eb in term 0.
I20260807 22:50:51.802204 29780 leader_election.cc:302] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b04a53f567a472e9bdc07716dab3fd5, 83ee8adc4ef542198b471d659adcf0eb; no voters:
I20260807 22:50:51.802533 30074 raft_consensus.cc:2781] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:50:51.802621 30074 raft_consensus.cc:482] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:50:51.802666 30074 raft_consensus.cc:3037] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:51.803714 30074 raft_consensus.cc:504] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:50:51.804055 30074 leader_election.cc:288] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [CANDIDATE]: Term 1 election: Requested vote from peers 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655), 96643797a37940c6b2178a4df4bc22b0 (127.12.112.193:40149)
I20260807 22:50:51.804371 30003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fa062245de54480afa8ea0b67369a6c" candidate_uuid: "83ee8adc4ef542198b471d659adcf0eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b04a53f567a472e9bdc07716dab3fd5"
I20260807 22:50:51.804427 29701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fa062245de54480afa8ea0b67369a6c" candidate_uuid: "83ee8adc4ef542198b471d659adcf0eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96643797a37940c6b2178a4df4bc22b0"
I20260807 22:50:51.804507 30003 raft_consensus.cc:3037] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:51.804576 29701 raft_consensus.cc:3037] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:50:51.805811 30003 raft_consensus.cc:2454] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83ee8adc4ef542198b471d659adcf0eb in term 1.
I20260807 22:50:51.805811 29701 raft_consensus.cc:2454] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83ee8adc4ef542198b471d659adcf0eb in term 1.
I20260807 22:50:51.806116 29780 leader_election.cc:302] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4b04a53f567a472e9bdc07716dab3fd5, 83ee8adc4ef542198b471d659adcf0eb, 96643797a37940c6b2178a4df4bc22b0; no voters:
I20260807 22:50:51.806360 30074 raft_consensus.cc:2781] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:50:51.806583 30074 raft_consensus.cc:686] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 1 LEADER]: Becoming Leader. State: Replica: 83ee8adc4ef542198b471d659adcf0eb, State: Running, Role: LEADER
I20260807 22:50:51.806903 30074 consensus_queue.cc:237] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:50:51.810106 29544 catalog_manager.cc:5495] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194). New cstate: current_term: 1 leader_uuid: "83ee8adc4ef542198b471d659adcf0eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260807 22:50:51.828117 30067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.824770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38998 (local address 127.12.112.194:44315)
0807 22:50:51.824889 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:50:51.824893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:50:51.824956 (+ 63us) server_negotiation.cc:407] Connection header received
0807 22:50:51.825098 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:50:51.825101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:50:51.825153 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:50:51.825240 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:50:51.825466 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.825963 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.826794 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:50:51.827014 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:50:51.827092 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:50:51.827360 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:50:51.827742 (+ 382us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:50:51.827829 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:50:51.827900 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 22:50:51.827946 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:50:51.833705 30003 raft_consensus.cc:1261] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5 [term 1 FOLLOWER]: Refusing update from remote peer 83ee8adc4ef542198b471d659adcf0eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:51.833701 29701 raft_consensus.cc:1261] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Refusing update from remote peer 83ee8adc4ef542198b471d659adcf0eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:50:51.834450 30079 consensus_queue.cc:1035] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:50:51.834643 30074 consensus_queue.cc:1035] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 22:50:51.834875 30055 tablet.cc:2369] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:50:51.841435 30082 mvcc.cc:205] Tried to move back new op lower bound from 7316041940303761408 to 7316041940203520000. Current Snapshot: MvccSnapshot[applied={T|T < 7316041940303761408}]
I20260807 22:50:51.849330 29544 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:50:51.849491 29544 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:50:51.851938 29544 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Sending DeleteTablet for 3 replicas of tablet 7fa062245de54480afa8ea0b67369a6c
I20260807 22:50:51.852670 29829 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fa062245de54480afa8ea0b67369a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:51 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:38986
I20260807 22:50:51.852662 29979 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fa062245de54480afa8ea0b67369a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:51 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:36628
I20260807 22:50:51.852942 29677 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fa062245de54480afa8ea0b67369a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:50:51 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:54360
I20260807 22:50:51.853215 30090 tablet_replica.cc:330] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: stopping tablet replica
I20260807 22:50:51.853346 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 29587
I20260807 22:50:51.853570 30090 raft_consensus.cc:2229] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:50:51.853996 30090 raft_consensus.cc:2258] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:51.854442 30091 tablet_replica.cc:330] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: stopping tablet replica
I20260807 22:50:51.854792 30091 raft_consensus.cc:2229] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:50:51.855149 30091 raft_consensus.cc:2258] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:50:51.857740 30090 ts_tablet_manager.cc:1905] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:51.859068 30091 ts_tablet_manager.cc:1905] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:50:51.861550 30090 ts_tablet_manager.cc:1918] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:51.861660 30090 log.cc:1196] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/7fa062245de54480afa8ea0b67369a6c
I20260807 22:50:51.862023 30090 ts_tablet_manager.cc:1939] T 7fa062245de54480afa8ea0b67369a6c P 83ee8adc4ef542198b471d659adcf0eb: Deleting consensus metadata
I20260807 22:50:51.862142 30091 ts_tablet_manager.cc:1918] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:50:51.862291 30091 log.cc:1196] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/7fa062245de54480afa8ea0b67369a6c
I20260807 22:50:51.862743 30091 ts_tablet_manager.cc:1939] T 7fa062245de54480afa8ea0b67369a6c P 4b04a53f567a472e9bdc07716dab3fd5: Deleting consensus metadata
I20260807 22:50:51.863354 29525 catalog_manager.cc:4841] TS 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315): tablet 7fa062245de54480afa8ea0b67369a6c (table test-table [id=5cad09936b104d408849bd8a0a47fc87]) successfully deleted
W20260807 22:50:51.863543 29527 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:40149 (error 108)
I20260807 22:50:51.863983 29526 catalog_manager.cc:4841] TS 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655): tablet 7fa062245de54480afa8ea0b67369a6c (table test-table [id=5cad09936b104d408849bd8a0a47fc87]) successfully deleted
I20260807 22:50:51.864809 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 29755
I20260807 22:50:51.865185 30066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:50:51.864820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40149 (local address 127.0.0.1:54376)
0807 22:50:51.864987 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 22:50:51.865070 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:40149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 22:50:51.867388 29527 catalog_manager.cc:4584] TS 96643797a37940c6b2178a4df4bc22b0 (127.12.112.193:40149): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7fa062245de54480afa8ea0b67369a6c: Network error: Client connection negotiation failed: client connection to 127.12.112.193:40149: connect: Connection refused (error 111)
I20260807 22:50:51.872037 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 29907
I20260807 22:50:51.878443 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 29504
I20260807 22:51:11.885951 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:46073
--webserver_interface=127.12.112.254
--webserver_port=41917
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:46073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:11.998642 30094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:11.999045 30094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:11.999114 30094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:12.003116 30094 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 22:51:12.003191 30094 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 22:51:12.003217 30094 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 22:51:12.003249 30094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:12.003293 30094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:12.003331 30094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:12.003367 30094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:12.003402 30094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:12.008615 30094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:46073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:46073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=41917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:12.009687 30094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:12.010747 30094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:12.019184 30100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:12.019168 30099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:12.019284 30094 server_base.cc:1034] running on GCE node
W20260807 22:51:12.019171 30102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:12.020195 30094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:12.021240 30094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:12.022372 30094 hybrid_clock.cc:648] HybridClock initialized: now 1786143072022346 us; error 49 us; skew 500 ppm
Aug 07 22:51:12 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143072, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:12.025107 30094 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:51:12.025913 30094 webserver.cc:460] Webserver started at http://127.12.112.254:41917/ using document root <none> and password file <none>
I20260807 22:51:12.026468 30094 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:12.026535 30094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:12.030089 30094 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:12.032104 30109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:12.033296 30094 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:51:12.033481 30094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "26076d742dc9419da95c5b90a9b0174a"
format_stamp: "Formatted at 2026-08-07 22:50:29 on dist-test-slave-tm1g"
server_key: "fccd38aac35c5bc2b9cb0cb5a3845df8"
server_key_iv: "fe96851cdfed35076179fc844291d75b"
server_key_version: "encryptionkey@0"
I20260807 22:51:12.033995 30094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:12.052333 30094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:12.055565 30094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:12.055722 30094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:12.062557 30094 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:46073
I20260807 22:51:12.062848 30163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:46073 every 8 connection(s)
I20260807 22:51:12.063657 30094 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:12.067798 30164 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:51:12.069320 30164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Bootstrap starting.
I20260807 22:51:12.073058 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 30094
I20260807 22:51:12.073518 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:40149
--local_ip_for_outbound_sockets=127.12.112.193
--tserver_master_addrs=127.12.112.254:46073
--webserver_port=33845
--webserver_interface=127.12.112.193
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:51:12.090716 30164 log.cc:824] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:12.104972 30164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:51:12.105438 30164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Bootstrap complete.
I20260807 22:51:12.110893 30164 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:51:12.111387 30164 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26076d742dc9419da95c5b90a9b0174a, State: Initialized, Role: FOLLOWER
I20260807 22:51:12.111929 30164 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:51:12.112071 30164 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:12.112135 30164 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:12.112227 30164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:51:12.114621 30164 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:51:12.114970 30164 leader_election.cc:302] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26076d742dc9419da95c5b90a9b0174a; no voters:
I20260807 22:51:12.115309 30164 leader_election.cc:288] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 22:51:12.115447 30168 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 22:51:12.115716 30168 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [term 3 LEADER]: Becoming Leader. State: Replica: 26076d742dc9419da95c5b90a9b0174a, State: Running, Role: LEADER
I20260807 22:51:12.116035 30168 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } }
I20260807 22:51:12.116649 30164 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:12.116906 30170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26076d742dc9419da95c5b90a9b0174a. Latest consensus state: current_term: 3 leader_uuid: "26076d742dc9419da95c5b90a9b0174a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } } }
I20260807 22:51:12.117035 30170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:12.117352 30169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "26076d742dc9419da95c5b90a9b0174a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26076d742dc9419da95c5b90a9b0174a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 46073 } } }
I20260807 22:51:12.117432 30169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:12.117465 30172 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:12.122656 30172 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:12.123406 30172 catalog_manager.cc:1259] Loaded cluster ID: aaae44fb66574199835b08d757fb6798
I20260807 22:51:12.123483 30172 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:12.125249 30172 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:12.125885 30172 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Loaded TSK: 0
I20260807 22:51:12.125972 30172 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 26076d742dc9419da95c5b90a9b0174a: Loaded TSK: 1
F20260807 22:51:12.126664 30172 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f15d8ada9ad google::LogMessage::Fail() at ??:0
@ 0x7f15d8add88a google::LogMessage::SendToLog() at ??:0
@ 0x7f15d8ada4de google::LogMessage::Flush() at ??:0
@ 0x7f15d8adba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f15db79e18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f15db796f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f15e343f7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f15e341999c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f15e341a178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f15e345bdf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f15e347a82b std::function<>::operator()() at ??:0
@ 0x7f15e3419b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f15e341af3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f15e3417579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f15e345b640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f15dad2c3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f15dad2cc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f15dad2e3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f15dad1d512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f15dc3616db start_thread at ??:0
@ 0x7f15d75d861f clone at ??:0
W20260807 22:51:12.221120 30166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:12.221338 30166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:12.221380 30166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:12.225669 30166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:12.225714 30166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:12.225771 30166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:51:12.231177 30166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:40149
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=33845
--tserver_master_addrs=127.12.112.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:12.232250 30166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:12.233273 30166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:12.243103 30216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:12.243113 30214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:12.243099 30213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:12.243570 30166 server_base.cc:1034] running on GCE node
I20260807 22:51:12.243996 30166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:12.244592 30166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:12.245777 30166 hybrid_clock.cc:648] HybridClock initialized: now 1786143072245750 us; error 43 us; skew 500 ppm
Aug 07 22:51:12 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143072, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:12.248586 30166 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:51:12.249449 30166 webserver.cc:460] Webserver started at http://127.12.112.193:33845/ using document root <none> and password file <none>
I20260807 22:51:12.250013 30166 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:12.250104 30166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:12.254021 30166 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:12.256292 30223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:12.257586 30166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:51:12.257715 30166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "96643797a37940c6b2178a4df4bc22b0"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "6927d6c8f5998ec66afc2a502821f1a9"
server_key_iv: "36abdc30695fec0266f3869a88a2928d"
server_key_version: "encryptionkey@0"
I20260807 22:51:12.258262 30166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:12.278082 30166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:12.281354 30166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:12.281565 30166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:12.282159 30166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:12.283355 30232 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:51:12.288779 30166 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:51:12.288854 30166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260807 22:51:12.288946 30166 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:51:12.290602 30166 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:51:12.290668 30166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:12.290951 30232 tablet_bootstrap.cc:492] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Bootstrap starting.
I20260807 22:51:12.301605 30166 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:40149
I20260807 22:51:12.301637 30347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:40149 every 8 connection(s)
I20260807 22:51:12.302678 30166 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:51:12.311712 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 30166
I20260807 22:51:12.312182 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:44315
--local_ip_for_outbound_sockets=127.12.112.194
--tserver_master_addrs=127.12.112.254:46073
--webserver_port=36137
--webserver_interface=127.12.112.194
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:51:12.312956 30232 log.cc:824] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:12.321884 30232 tablet_bootstrap.cc:492] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:51:12.322382 30232 tablet_bootstrap.cc:492] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Bootstrap complete.
I20260807 22:51:12.323873 30232 ts_tablet_manager.cc:1397] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Time spent bootstrapping tablet: real 0.033s user 0.017s sys 0.014s
I20260807 22:51:12.327159 30232 raft_consensus.cc:348] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:51:12.327720 30232 raft_consensus.cc:729] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96643797a37940c6b2178a4df4bc22b0, State: Initialized, Role: FOLLOWER
I20260807 22:51:12.328258 30232 consensus_queue.cc:260] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:51:12.329432 30232 ts_tablet_manager.cc:1428] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260807 22:51:12.375180 30351 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:51:12.304596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:43731)
0807 22:51:12.305082 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:12.305135 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:12.305957 (+ 822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:12.374383 (+ 68426us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":151,"threads_started":1}
W20260807 22:51:12.375687 30348 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:46073 (0 consecutive failures): Network error: Failed to ping master at 127.12.112.254:46073: Client connection negotiation failed: client connection to 127.12.112.254:46073: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 22:51:12.376462 30351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:12.376214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:39019)
0807 22:51:12.376346 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:12.376409 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 22:51:12.377192 30351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:12.377005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:57535)
0807 22:51:12.377106 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:12.377148 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 22:51:12.377421 30348 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:51:12.429260 30353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:12.429505 30353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:12.429548 30353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:12.433524 30353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:12.433583 30353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:12.433674 30353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:51:12.439118 30353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:44315
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=36137
--tserver_master_addrs=127.12.112.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:12.440166 30353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:12.441215 30353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:12.450867 30360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:12.450861 30364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:12.450867 30362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:12.451202 30353 server_base.cc:1034] running on GCE node
I20260807 22:51:12.451680 30353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:12.452353 30353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:12.453545 30353 hybrid_clock.cc:648] HybridClock initialized: now 1786143072453536 us; error 30 us; skew 500 ppm
Aug 07 22:51:12 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143072, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:12.456318 30353 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:51:12.457188 30353 webserver.cc:460] Webserver started at http://127.12.112.194:36137/ using document root <none> and password file <none>
I20260807 22:51:12.457748 30353 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:12.457851 30353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:12.461746 30353 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:12.463982 30371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:12.465230 30353 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:51:12.465395 30353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "83ee8adc4ef542198b471d659adcf0eb"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "b2b665ad0176d0ecf3c96ceb0e95c5d4"
server_key_iv: "26b90758501a7cd85afa4fd8bdb0978b"
server_key_version: "encryptionkey@0"
I20260807 22:51:12.465957 30353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:12.484671 30353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:12.487927 30353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:12.488153 30353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:12.488988 30353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:12.490200 30353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:12.490267 30353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:12.490355 30353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:12.490386 30353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:12.502452 30353 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:44315
I20260807 22:51:12.502496 30494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:44315 every 8 connection(s)
I20260807 22:51:12.503567 30353 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:51:12.507354 30497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:12.505806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:54199)
0807 22:51:12.506542 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:12.506652 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":137,"threads_started":1}
W20260807 22:51:12.507797 30495 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:46073 (0 consecutive failures): Network error: Failed to ping master at 127.12.112.254:46073: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
I20260807 22:51:12.508426 30497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:12.508199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:37021)
0807 22:51:12.508314 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:12.508372 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 22:51:12.509079 30497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:12.508885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:52651)
0807 22:51:12.508993 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:12.509034 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 22:51:12.509289 30495 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 22:51:12.510068 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 30353
I20260807 22:51:12.510596 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:34655
--local_ip_for_outbound_sockets=127.12.112.195
--tserver_master_addrs=127.12.112.254:46073
--webserver_port=46639
--webserver_interface=127.12.112.195
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:12.620378 30498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:12.620625 30498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:12.620667 30498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:12.624565 30498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:12.624617 30498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:12.624672 30498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:51:12.629766 30498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:34655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=46639
--tserver_master_addrs=127.12.112.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:12.630700 30498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:12.631629 30498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:12.641412 30504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:12.641392 30503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:12.641392 30506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:12.641875 30498 server_base.cc:1034] running on GCE node
I20260807 22:51:12.642259 30498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:12.642971 30498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:12.644132 30498 hybrid_clock.cc:648] HybridClock initialized: now 1786143072644113 us; error 29 us; skew 500 ppm
Aug 07 22:51:12 dist-test-slave-tm1g krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143072, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:12.646764 30498 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:51:12.647632 30498 webserver.cc:460] Webserver started at http://127.12.112.195:46639/ using document root <none> and password file <none>
I20260807 22:51:12.648186 30498 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:12.648278 30498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:12.651980 30498 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 22:51:12.654022 30513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:12.655279 30498 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260807 22:51:12.655418 30498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "4b04a53f567a472e9bdc07716dab3fd5"
format_stamp: "Formatted at 2026-08-07 22:50:30 on dist-test-slave-tm1g"
server_key: "56a953989d3c42d2aeae606b5c5628fd"
server_key_iv: "df12191c2d59062383e3ec4468ccdbd1"
server_key_version: "encryptionkey@0"
I20260807 22:51:12.655943 30498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:12.681789 30498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:12.684664 30498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:12.684868 30498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:12.685477 30498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:12.686363 30498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:12.686429 30498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:12.686503 30498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:12.686545 30498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:12.695847 30498 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:34655
I20260807 22:51:12.695875 30637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:34655 every 8 connection(s)
I20260807 22:51:12.696802 30498 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:51:12.697520 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 30498
I20260807 22:51:12.700480 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:12.699099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:55153)
0807 22:51:12.699715 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:12.699814 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":110,"threads_started":1}
W20260807 22:51:12.700953 30638 heartbeater.cc:644] Failed to heartbeat to 127.12.112.254:46073 (0 consecutive failures): Network error: Failed to ping master at 127.12.112.254:46073: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
I20260807 22:51:12.701459 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:12.701254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:41669)
0807 22:51:12.701362 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:12.701406 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 22:51:12.702039 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:12.701841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:34797)
0807 22:51:12.701941 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:12.701985 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 22:51:12.702207 30638 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 22:51:13.378584 30642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:13.378116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:47345)
0807 22:51:13.378417 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:13.378471 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":74,"threads_started":1}
I20260807 22:51:13.510202 30643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:13.509805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:55667)
0807 22:51:13.510063 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:13.510110 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":76,"threads_started":1}
I20260807 22:51:13.703372 30644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:13.702883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:57919)
0807 22:51:13.703182 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:13.703248 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":101,"threads_started":1}
I20260807 22:51:14.166605 30645 raft_consensus.cc:482] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:14.166796 30645 raft_consensus.cc:504] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:51:14.167809 30645 leader_election.cc:288] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655), 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315)
Aug 07 22:51:14 dist-test-slave-tm1g krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143072, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.194@KRBTEST.COM
Aug 07 22:51:14 dist-test-slave-tm1g krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143072, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.195@KRBTEST.COM
I20260807 22:51:14.185930 30649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:14.168225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:42529 (local address 127.12.112.194:44315)
0807 22:51:14.168517 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:14.168533 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:14.168581 (+ 48us) server_negotiation.cc:407] Connection header received
0807 22:51:14.169321 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:14.169327 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:14.169709 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:14.170086 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:14.171390 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:14.172378 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:14.173552 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:14.174130 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:14.174293 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:14.181278 (+ 6985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:14.181283 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:14.181294 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:14.181321 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:14.183140 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:14.183697 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:14.183702 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:14.183705 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:14.183815 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:14.184437 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:14.184442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:14.184444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:14.184862 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:14.185008 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:14.185503 (+ 495us) server_negotiation.cc:299] Negotiation successful
0807 22:51:14.185757 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":71,"threads_started":1}
I20260807 22:51:14.185920 30646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:14.168055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:44315 (local address 127.12.112.193:42529)
0807 22:51:14.168398 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:14.168416 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:14.168525 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:14.170139 (+ 1614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:14.170145 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:14.170752 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:14.171221 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:14.171235 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:14.172515 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:14.172520 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:14.173403 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:14.173417 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:14.174255 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:14.174258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:14.174479 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:14.179369 (+ 4890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:14.179381 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:14.181018 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:14.183281 (+ 2263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:14.183293 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:14.183304 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:14.183562 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:14.183926 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:14.183929 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:14.183931 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:14.184071 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:14.184985 (+ 914us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:14.184989 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:14.185185 (+ 196us) client_negotiation.cc:769] Sending connection context
0807 22:51:14.185376 (+ 191us) client_negotiation.cc:240] Negotiation successful
0807 22:51:14.185728 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":84,"spinlock_wait_cycles":35456,"thread_start_us":96,"threads_started":1}
I20260807 22:51:14.185973 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:14.168225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:60885 (local address 127.12.112.195:34655)
0807 22:51:14.168629 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:14.168659 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:14.168716 (+ 57us) server_negotiation.cc:407] Connection header received
0807 22:51:14.169487 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:14.169492 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:14.169785 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:14.170120 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:14.171390 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:14.172365 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:14.173532 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:14.174139 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:14.174336 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:14.181597 (+ 7261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:14.181605 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:14.181619 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:14.181655 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:14.183451 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:14.183891 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:14.183896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:14.183901 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:14.184079 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:14.184369 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:14.184372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:14.184374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:14.184833 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:14.184979 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:14.185506 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 22:51:14.185785 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":106,"threads_started":1}
I20260807 22:51:14.186029 30648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:14.168055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:34655 (local address 127.12.112.193:60885)
0807 22:51:14.168622 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:14.168638 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:14.168783 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:14.170138 (+ 1355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:14.170144 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:14.170766 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:14.171222 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:14.171235 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:14.172513 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:14.172516 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:14.173389 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:14.173421 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:14.174291 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:14.174294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:14.174481 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:14.179353 (+ 4872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:14.179369 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:14.181385 (+ 2016us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:14.183572 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:14.183577 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:14.183579 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:14.183777 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:14.184170 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:14.184174 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:14.184176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:14.184267 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:14.184953 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:14.184959 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:14.185185 (+ 226us) client_negotiation.cc:769] Sending connection context
0807 22:51:14.185375 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 22:51:14.185813 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"mutex_wait_us":307,"spinlock_wait_cycles":5760,"thread_start_us":62,"threads_started":1}
W20260807 22:51:14.188737 30225 leader_election.cc:341] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315): Not found: Tablet not found: 7fa062245de54480afa8ea0b67369a6c
W20260807 22:51:14.189083 30226 leader_election.cc:341] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655): Not found: Tablet not found: 7fa062245de54480afa8ea0b67369a6c
I20260807 22:51:14.189158 30226 leader_election.cc:302] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96643797a37940c6b2178a4df4bc22b0; no voters: 4b04a53f567a472e9bdc07716dab3fd5, 83ee8adc4ef542198b471d659adcf0eb
I20260807 22:51:14.189455 30645 raft_consensus.cc:2726] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:51:14.379540 30648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:14.379274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:49159)
0807 22:51:14.379403 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:14.379455 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 22:51:14.511294 30651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:14.510891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:37613)
0807 22:51:14.511142 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:14.511196 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":74,"threads_started":1}
I20260807 22:51:14.704510 30652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:14.704114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:54537)
0807 22:51:14.704366 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:14.704419 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":69,"threads_started":1}
I20260807 22:51:15.380684 30653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:15.380236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:56173)
0807 22:51:15.380520 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:15.380586 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":97,"threads_started":1}
I20260807 22:51:15.512482 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:15.512048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:59545)
0807 22:51:15.512340 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:15.512394 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":94,"threads_started":1}
I20260807 22:51:15.705698 30655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:15.705239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:34241)
0807 22:51:15.705528 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:15.705584 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":95,"threads_started":1}
I20260807 22:51:15.958528 30656 raft_consensus.cc:482] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:15.958695 30656 raft_consensus.cc:504] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:51:15.959163 30656 leader_election.cc:288] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655), 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315)
W20260807 22:51:15.960101 30225 leader_election.cc:341] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315): Not found: Tablet not found: 7fa062245de54480afa8ea0b67369a6c
W20260807 22:51:15.960206 30226 leader_election.cc:341] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655): Not found: Tablet not found: 7fa062245de54480afa8ea0b67369a6c
I20260807 22:51:15.960314 30226 leader_election.cc:302] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96643797a37940c6b2178a4df4bc22b0; no voters: 4b04a53f567a472e9bdc07716dab3fd5, 83ee8adc4ef542198b471d659adcf0eb
I20260807 22:51:15.960485 30656 raft_consensus.cc:2726] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:51:16.381852 30657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:16.381431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:41355)
0807 22:51:16.381688 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:16.381742 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":76,"threads_started":1}
I20260807 22:51:16.513685 30658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:16.513248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:59197)
0807 22:51:16.513519 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:16.513574 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":79,"threads_started":1}
I20260807 22:51:16.706949 30659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:16.706522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:60485)
0807 22:51:16.706793 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:16.706861 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":75,"threads_started":1}
I20260807 22:51:17.383288 30660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:17.382807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:44267)
0807 22:51:17.383125 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:17.383183 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":85,"threads_started":1}
I20260807 22:51:17.514931 30661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:17.514540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:60983)
0807 22:51:17.514781 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:17.514838 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":64,"threads_started":1}
I20260807 22:51:17.708040 30662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:17.707656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:41725)
0807 22:51:17.707898 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:17.707951 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":76,"threads_started":1}
I20260807 22:51:18.384398 30663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:18.383983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:53777)
0807 22:51:18.384239 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:18.384301 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":74,"threads_started":1}
I20260807 22:51:18.516037 30664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:18.515622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:39321)
0807 22:51:18.515892 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:18.515948 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":75,"threads_started":1}
I20260807 22:51:18.709134 30665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:18.708761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:37349)
0807 22:51:18.708996 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:18.709049 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":77,"threads_started":1}
I20260807 22:51:18.912508 30667 raft_consensus.cc:482] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:18.912648 30667 raft_consensus.cc:504] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:51:18.913193 30667 leader_election.cc:288] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655), 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315)
W20260807 22:51:18.914006 30226 leader_election.cc:341] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655): Not found: Tablet not found: 7fa062245de54480afa8ea0b67369a6c
W20260807 22:51:18.914131 30225 leader_election.cc:341] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315): Not found: Tablet not found: 7fa062245de54480afa8ea0b67369a6c
I20260807 22:51:18.914244 30225 leader_election.cc:302] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96643797a37940c6b2178a4df4bc22b0; no voters: 4b04a53f567a472e9bdc07716dab3fd5, 83ee8adc4ef542198b471d659adcf0eb
I20260807 22:51:18.914533 30667 raft_consensus.cc:2726] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:51:19.385633 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:19.385215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:43189)
0807 22:51:19.385486 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:19.385539 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":108,"threads_started":1}
I20260807 22:51:19.517279 30669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:19.516781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:33045)
0807 22:51:19.517119 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:19.517176 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":70,"threads_started":1}
I20260807 22:51:19.710384 30670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:19.709888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:53973)
0807 22:51:19.710180 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:19.710233 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":69,"threads_started":1}
I20260807 22:51:20.386816 30671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:20.386416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:37075)
0807 22:51:20.386668 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:20.386721 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":92,"threads_started":1}
I20260807 22:51:20.518441 30672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:20.518020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:34415)
0807 22:51:20.518270 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:20.518344 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":77,"threads_started":1}
I20260807 22:51:20.711586 30673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:20.711183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:34015)
0807 22:51:20.711442 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:20.711495 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":88,"threads_started":1}
I20260807 22:51:21.387935 30674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:21.387544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:60199)
0807 22:51:21.387789 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:21.387841 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":79,"threads_started":1}
I20260807 22:51:21.519603 30675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:21.519157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:35689)
0807 22:51:21.519409 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:21.519465 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":93,"threads_started":1}
I20260807 22:51:21.701285 30676 raft_consensus.cc:482] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:21.701417 30676 raft_consensus.cc:504] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:51:21.701907 30676 leader_election.cc:288] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655), 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315)
W20260807 22:51:21.702687 30226 leader_election.cc:341] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655): Not found: Tablet not found: 7fa062245de54480afa8ea0b67369a6c
W20260807 22:51:21.702776 30225 leader_election.cc:341] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315): Not found: Tablet not found: 7fa062245de54480afa8ea0b67369a6c
I20260807 22:51:21.702878 30225 leader_election.cc:302] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96643797a37940c6b2178a4df4bc22b0; no voters: 4b04a53f567a472e9bdc07716dab3fd5, 83ee8adc4ef542198b471d659adcf0eb
I20260807 22:51:21.703027 30676 raft_consensus.cc:2726] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:51:21.712688 30677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:21.712265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:38015)
0807 22:51:21.712541 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:21.712598 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":113,"threads_started":1}
I20260807 22:51:22.389346 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:22.388835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:48183)
0807 22:51:22.389134 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:22.389204 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":106,"threads_started":1}
I20260807 22:51:22.520923 30679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:22.520526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:35679)
0807 22:51:22.520769 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:22.520821 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":78,"threads_started":1}
I20260807 22:51:22.713907 30680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:22.713464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:51241)
0807 22:51:22.713754 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:22.713814 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":92,"threads_started":1}
I20260807 22:51:23.390578 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:23.390093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:33597)
0807 22:51:23.390414 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:23.390481 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":91,"threads_started":1}
I20260807 22:51:23.522166 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:23.521740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:55427)
0807 22:51:23.522023 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:23.522075 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":94,"threads_started":1}
I20260807 22:51:23.715062 30684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:23.714675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:55761)
0807 22:51:23.714917 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:23.714968 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":75,"threads_started":1}
I20260807 22:51:24.391754 30685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:24.391331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:55047)
0807 22:51:24.391596 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:24.391651 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":91,"threads_started":1}
I20260807 22:51:24.523379 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:24.522973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:58873)
0807 22:51:24.523217 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:24.523270 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":76,"threads_started":1}
I20260807 22:51:24.716346 30687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:24.715791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:50297)
0807 22:51:24.716143 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:24.716214 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":125,"threads_started":1}
I20260807 22:51:25.392968 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:25.392515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:37493)
0807 22:51:25.392813 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:25.392870 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":83,"threads_started":1}
I20260807 22:51:25.524503 30689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:25.524088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:49987)
0807 22:51:25.524354 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:25.524410 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":79,"threads_started":1}
I20260807 22:51:25.717600 30690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:25.717190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:38639)
0807 22:51:25.717451 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:25.717505 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":75,"threads_started":1}
I20260807 22:51:26.394179 30692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:26.393772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:48179)
0807 22:51:26.394028 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:26.394085 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":73,"threads_started":1}
I20260807 22:51:26.525830 30693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:26.525364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:48193)
0807 22:51:26.525672 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:26.525722 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":79,"threads_started":1}
I20260807 22:51:26.718987 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:26.718548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.195:52961)
0807 22:51:26.718834 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:26.718892 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":105,"threads_started":1}
I20260807 22:51:27.204787 30695 raft_consensus.cc:482] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:27.205003 30695 raft_consensus.cc:504] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04a53f567a472e9bdc07716dab3fd5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 34655 } } peers { permanent_uuid: "83ee8adc4ef542198b471d659adcf0eb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 44315 } } peers { permanent_uuid: "96643797a37940c6b2178a4df4bc22b0" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40149 } }
I20260807 22:51:27.205458 30695 leader_election.cc:288] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655), 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315)
W20260807 22:51:27.206234 30226 leader_election.cc:341] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b04a53f567a472e9bdc07716dab3fd5 (127.12.112.195:34655): Not found: Tablet not found: 7fa062245de54480afa8ea0b67369a6c
W20260807 22:51:27.206387 30225 leader_election.cc:341] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83ee8adc4ef542198b471d659adcf0eb (127.12.112.194:44315): Not found: Tablet not found: 7fa062245de54480afa8ea0b67369a6c
I20260807 22:51:27.206490 30225 leader_election.cc:302] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96643797a37940c6b2178a4df4bc22b0; no voters: 4b04a53f567a472e9bdc07716dab3fd5, 83ee8adc4ef542198b471d659adcf0eb
I20260807 22:51:27.206648 30695 raft_consensus.cc:2726] T 7fa062245de54480afa8ea0b67369a6c P 96643797a37940c6b2178a4df4bc22b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:51:27.395661 30696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:27.395234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.193:59321)
0807 22:51:27.395507 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:27.395565 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":75,"threads_started":1}
I20260807 22:51:27.527824 30697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:27.526915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:46073 (local address 127.12.112.194:38263)
0807 22:51:27.527521 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:27.527695 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.254:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":74,"threads_started":1}
I20260807 22:51:27.699043 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 30166
I20260807 22:51:27.707557 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 30353
I20260807 22:51:27.714726 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 30498
2026-08-07T22:51:27Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59194 ms)
[----------] 30 tests from SecurityITest (243985 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:27 dist-test-slave-tm1g krb5kdc[30700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:27 dist-test-slave-tm1g krb5kdc[30700](info): set up 2 sockets
Aug 07 22:51:27 dist-test-slave-tm1g krb5kdc[30700](info): commencing operation
krb5kdc: starting...
W20260807 22:51:28.782166 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:28 dist-test-slave-tm1g krb5kdc[30700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:51:28.903267 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33547
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:33547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:29.009748 30716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:29.009975 30716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:29.010013 30716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:29.014434 30716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:29.014484 30716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:29.014503 30716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:29.014519 30716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:29.014534 30716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:29.019450 30716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:33547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:29.020308 30716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:29.021210 30716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:51:29.029716 30716 server_base.cc:1034] running on GCE node
W20260807 22:51:29.029733 30723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:29.029724 30722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:29.029767 30725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:29.030541 30716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:29.031555 30716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:29.032738 30716 hybrid_clock.cc:648] HybridClock initialized: now 1786143089032717 us; error 33 us; skew 500 ppm
Aug 07 22:51:29 dist-test-slave-tm1g krb5kdc[30700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:29.040459 30716 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:51:29.041308 30716 webserver.cc:460] Webserver started at http://127.12.112.254:39373/ using document root <none> and password file <none>
I20260807 22:51:29.041857 30716 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:29.041954 30716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:29.042183 30716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:29.044229 30716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "eb5c05e81e4649ecaf47a60b9f753030"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "ab7cc14ce551e4bc3bdb9bf26f7dfafd"
server_key_iv: "0b3089de7dd4ac864acdcbddd959c121"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.044795 30716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "eb5c05e81e4649ecaf47a60b9f753030"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "ab7cc14ce551e4bc3bdb9bf26f7dfafd"
server_key_iv: "0b3089de7dd4ac864acdcbddd959c121"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.048437 30716 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:51:29.050758 30732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:29.051892 30716 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:29.052031 30716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "eb5c05e81e4649ecaf47a60b9f753030"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "ab7cc14ce551e4bc3bdb9bf26f7dfafd"
server_key_iv: "0b3089de7dd4ac864acdcbddd959c121"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.052143 30716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:29.077033 30716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:29.079906 30716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:29.080104 30716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:29.086956 30716 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:33547
I20260807 22:51:29.086979 30785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:33547 every 8 connection(s)
I20260807 22:51:29.087852 30716 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:29.088933 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 30716
I20260807 22:51:29.089062 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:29.089349 12739 external_mini_cluster.cc:1428] Setting key 8156eb66cf7bce9611f1b1d84557d0d7
I20260807 22:51:29.090754 30786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:29.096035 30786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030: Bootstrap starting.
Aug 07 22:51:29 dist-test-slave-tm1g krb5kdc[30700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:29.098516 30786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:29.099345 30786 log.cc:824] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:29.101145 30786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030: No bootstrap required, opened a new log
I20260807 22:51:29.103346 30789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.090800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49344 (local address 127.12.112.254:33547)
0807 22:51:29.091235 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:29.091250 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:29.091285 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:51:29.091908 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:29.091923 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:29.092212 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:29.092550 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:29.093393 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.094433 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.095288 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.095758 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.095931 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.098663 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:29.098668 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:29.098681 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:29.098707 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:29.100292 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:29.100769 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:29.100773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:29.100777 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:29.100892 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:29.101185 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:29.101189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:29.101191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:29.101600 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:29.101808 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:29.102102 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 22:51:29.102467 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":145,"threads_started":1}
I20260807 22:51:29.105647 30786 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb5c05e81e4649ecaf47a60b9f753030" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33547 } }
I20260807 22:51:29.105907 30786 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:29.105967 30786 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb5c05e81e4649ecaf47a60b9f753030, State: Initialized, Role: FOLLOWER
I20260807 22:51:29.106396 30786 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb5c05e81e4649ecaf47a60b9f753030" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33547 } }
I20260807 22:51:29.106550 30786 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:29.106616 30786 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:29.106705 30786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:29.107513 30786 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb5c05e81e4649ecaf47a60b9f753030" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33547 } }
I20260807 22:51:29.107833 30786 leader_election.cc:302] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb5c05e81e4649ecaf47a60b9f753030; no voters:
I20260807 22:51:29.108145 30786 leader_election.cc:288] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:29.108287 30791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:29.108532 30791 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [term 1 LEADER]: Becoming Leader. State: Replica: eb5c05e81e4649ecaf47a60b9f753030, State: Running, Role: LEADER
I20260807 22:51:29.108853 30791 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb5c05e81e4649ecaf47a60b9f753030" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33547 } }
I20260807 22:51:29.109333 30786 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:29.110448 30793 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb5c05e81e4649ecaf47a60b9f753030" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb5c05e81e4649ecaf47a60b9f753030" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33547 } } }
I20260807 22:51:29.110591 30793 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:29.110949 30794 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb5c05e81e4649ecaf47a60b9f753030. Latest consensus state: current_term: 1 leader_uuid: "eb5c05e81e4649ecaf47a60b9f753030" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb5c05e81e4649ecaf47a60b9f753030" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33547 } } }
I20260807 22:51:29.111011 30801 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:29.111085 30794 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:29.113688 30801 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:29.118583 30801 catalog_manager.cc:1347] Generated new cluster ID: 896fdd16ce0142a3903b9057297d0ec6
I20260807 22:51:29.118642 30801 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:29.122920 30801 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:29.124064 30801 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:29.130658 30801 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030: Generated new TSK 0
I20260807 22:51:29.131325 30801 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:51:29.165786 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33547
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:29.276100 30815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:29.276341 30815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:29.276389 30815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:29.280418 30815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:29.280469 30815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:29.280555 30815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:51:29.285624 30815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:29.286598 30815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:29.287526 30815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:29.297013 30820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:29.297001 30821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:29.297001 30823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:29.297323 30815 server_base.cc:1034] running on GCE node
I20260807 22:51:29.297679 30815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:29.298250 30815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:29.299522 30815 hybrid_clock.cc:648] HybridClock initialized: now 1786143089299502 us; error 30 us; skew 500 ppm
Aug 07 22:51:29 dist-test-slave-tm1g krb5kdc[30700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:29.302284 30815 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:51:29.303150 30815 webserver.cc:460] Webserver started at http://127.12.112.193:35005/ using document root <none> and password file <none>
I20260807 22:51:29.303645 30815 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:29.303701 30815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:29.303861 30815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:29.305759 30815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "d1cc2de52fdc4ba7916b38ba588192e2"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "a36ec570eba7281741502e9856667869"
server_key_iv: "3a117f1d5c3fdacba5498135145b39df"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.306259 30815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "d1cc2de52fdc4ba7916b38ba588192e2"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "a36ec570eba7281741502e9856667869"
server_key_iv: "3a117f1d5c3fdacba5498135145b39df"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.309865 30815 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260807 22:51:29.312264 30830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:29.313413 30815 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:51:29.313529 30815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "d1cc2de52fdc4ba7916b38ba588192e2"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "a36ec570eba7281741502e9856667869"
server_key_iv: "3a117f1d5c3fdacba5498135145b39df"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.313627 30815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:29.327560 30815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:29.330674 30815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:29.330866 30815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:29.331475 30815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:29.332371 30815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:29.332417 30815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:29.332453 30815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:29.332468 30815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:29.340797 30815 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:39713
I20260807 22:51:29.340850 30949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:39713 every 8 connection(s)
I20260807 22:51:29.341615 30815 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
Aug 07 22:51:29 dist-test-slave-tm1g krb5kdc[30700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:29.351717 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 30815
I20260807 22:51:29.351859 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:51:29.352227 12739 external_mini_cluster.cc:1428] Setting key 8944ef5ac18d023d6b7a04b27c4c5243
I20260807 22:51:29.355198 30789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.343306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:39399 (local address 127.12.112.254:33547)
0807 22:51:29.343465 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:29.343469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:29.344264 (+ 795us) server_negotiation.cc:407] Connection header received
0807 22:51:29.345517 (+ 1253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:29.345520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:29.345567 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:29.345641 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:29.346775 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.347331 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.348412 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.348645 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.348726 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.351156 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:29.351159 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:29.351161 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:29.351184 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:29.352744 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:29.353346 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:29.353349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:29.353351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:29.353430 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:29.353897 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:29.353901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:29.353903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:29.354147 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:29.354266 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:29.354795 (+ 529us) server_negotiation.cc:299] Negotiation successful
0807 22:51:29.354955 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 22:51:29.355835 30952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.343676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33547 (local address 127.12.112.193:39399)
0807 22:51:29.344113 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:29.344154 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:29.345322 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:29.345791 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:29.345797 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:29.346114 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:29.346642 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.346655 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.347438 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.347440 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.348301 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.348309 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.348772 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.348775 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.348907 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.349458 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:29.349474 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:29.351005 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:29.352890 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:29.352894 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:29.352905 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:29.353244 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:29.353575 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:29.353578 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:29.353583 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:29.353776 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:29.354261 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:29.354266 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:29.354560 (+ 294us) client_negotiation.cc:769] Sending connection context
0807 22:51:29.354711 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 22:51:29.354940 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":126,"threads_started":1}
I20260807 22:51:29.357194 30950 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33547
I20260807 22:51:29.357437 30950 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:29.357969 30950 heartbeater.cc:511] Master 127.12.112.254:33547 requested a full tablet report, sending...
I20260807 22:51:29.359547 30749 ts_manager.cc:194] Registered new tserver with Master: d1cc2de52fdc4ba7916b38ba588192e2 (127.12.112.193:39713)
I20260807 22:51:29.360647 30749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:39399
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:51:29.380839 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33547
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:29.489727 30955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:29.490000 30955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:29.490075 30955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:29.494042 30955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:29.494127 30955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:29.494216 30955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:51:29.499300 30955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:29.500229 30955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:29.501168 30955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:29.510527 30961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:29.510535 30960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:29.510535 30963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:29.510900 30955 server_base.cc:1034] running on GCE node
I20260807 22:51:29.511374 30955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:29.511967 30955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:29.513130 30955 hybrid_clock.cc:648] HybridClock initialized: now 1786143089513101 us; error 40 us; skew 500 ppm
Aug 07 22:51:29 dist-test-slave-tm1g krb5kdc[30700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:29.515914 30955 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:51:29.516762 30955 webserver.cc:460] Webserver started at http://127.12.112.194:38479/ using document root <none> and password file <none>
I20260807 22:51:29.517309 30955 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:29.517409 30955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:29.517637 30955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:29.519626 30955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "6fe8ca778b90418d83ed4fd02054a6db"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "d08fa5996bde52c0610cadb2795173f8"
server_key_iv: "fc8546cb79c0365a402aa94dc470ab69"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.520170 30955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "6fe8ca778b90418d83ed4fd02054a6db"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "d08fa5996bde52c0610cadb2795173f8"
server_key_iv: "fc8546cb79c0365a402aa94dc470ab69"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.523770 30955 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:51:29.526021 30972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:29.527215 30955 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:51:29.527348 30955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "6fe8ca778b90418d83ed4fd02054a6db"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "d08fa5996bde52c0610cadb2795173f8"
server_key_iv: "fc8546cb79c0365a402aa94dc470ab69"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.527467 30955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:29.544072 30955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:29.547325 30955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:29.547523 30955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:29.548085 30955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:29.548877 30955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:29.548949 30955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:29.549016 30955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:29.549067 30955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:29.558102 30955 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:38351
I20260807 22:51:29.558133 31097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:38351 every 8 connection(s)
I20260807 22:51:29.559026 30955 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:51:29.566963 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 30955
I20260807 22:51:29.567116 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:51:29.567427 12739 external_mini_cluster.cc:1428] Setting key faa58fb341f478ea4b268798537b59d2
Aug 07 22:51:29 dist-test-slave-tm1g krb5kdc[30700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:29.572963 30789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.560702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:34105 (local address 127.12.112.254:33547)
0807 22:51:29.560836 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:29.560840 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:29.561633 (+ 793us) server_negotiation.cc:407] Connection header received
0807 22:51:29.563090 (+ 1457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:29.563094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:29.563154 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:29.563230 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:29.564305 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.564852 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.566024 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.566271 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.566439 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.569032 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:29.569037 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:29.569040 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:29.569067 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:29.570793 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:29.571421 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:29.571424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:29.571425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:29.571503 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:29.571882 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:29.571884 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:29.571885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:29.572047 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:29.572124 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:29.572746 (+ 622us) server_negotiation.cc:299] Negotiation successful
0807 22:51:29.572843 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:51:29.574162 31100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.561074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33547 (local address 127.12.112.194:34105)
0807 22:51:29.561494 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:29.561535 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:29.562874 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:29.563391 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:29.563398 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:29.563715 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:29.564156 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.564168 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.564989 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.564999 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.565892 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.565902 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.566472 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.566476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.566649 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.567263 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:29.567290 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:29.568857 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:29.570910 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:29.570915 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:29.570925 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:29.571310 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:29.571594 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:29.571599 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:29.571602 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:29.571785 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:29.572152 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:29.572160 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:29.572498 (+ 338us) client_negotiation.cc:769] Sending connection context
0807 22:51:29.572708 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 22:51:29.573074 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":110,"threads_started":1}
I20260807 22:51:29.575486 31098 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33547
I20260807 22:51:29.575721 31098 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:29.576197 31098 heartbeater.cc:511] Master 127.12.112.254:33547 requested a full tablet report, sending...
I20260807 22:51:29.577247 30749 ts_manager.cc:194] Registered new tserver with Master: 6fe8ca778b90418d83ed4fd02054a6db (127.12.112.194:38351)
I20260807 22:51:29.577818 30749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:34105
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:51:29.596796 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33547
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:29.705994 31103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:29.706250 31103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:29.706357 31103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:29.710496 31103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:29.710568 31103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:29.710677 31103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:51:29.715822 31103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:33547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:29.716832 31103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:29.717867 31103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:29.727056 31108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:29.727056 31109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:29.727159 31103 server_base.cc:1034] running on GCE node
W20260807 22:51:29.727324 31112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:29.727712 31103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:29.728335 31103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:29.729522 31103 hybrid_clock.cc:648] HybridClock initialized: now 1786143089729509 us; error 33 us; skew 500 ppm
Aug 07 22:51:29 dist-test-slave-tm1g krb5kdc[30700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:29.732511 31103 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:51:29.733309 31103 webserver.cc:460] Webserver started at http://127.12.112.195:41861/ using document root <none> and password file <none>
I20260807 22:51:29.733790 31103 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:29.733845 31103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:29.734001 31103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:29.735925 31103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "ea5e05c4282c4b85a2ff383c51517b0f"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "b297890e7e7678b924d296618b70dea0"
server_key_iv: "681458564eabcb60d010b2e5957a58b5"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.736438 31103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "ea5e05c4282c4b85a2ff383c51517b0f"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "b297890e7e7678b924d296618b70dea0"
server_key_iv: "681458564eabcb60d010b2e5957a58b5"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.739940 31103 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:51:29.743734 31119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:29.745236 31103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:51:29.745402 31103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "ea5e05c4282c4b85a2ff383c51517b0f"
format_stamp: "Formatted at 2026-08-07 22:51:29 on dist-test-slave-tm1g"
server_key: "b297890e7e7678b924d296618b70dea0"
server_key_iv: "681458564eabcb60d010b2e5957a58b5"
server_key_version: "encryptionkey@0"
I20260807 22:51:29.745519 31103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:29.756488 31103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:29.759584 31103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:29.759776 31103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:29.760311 31103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:29.761094 31103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:29.761164 31103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:29.761234 31103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:29.761286 31103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:29.769765 31103 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:38515
I20260807 22:51:29.769842 31241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:38515 every 8 connection(s)
I20260807 22:51:29.770762 31103 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:51:29.772922 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 31103
I20260807 22:51:29.773056 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:51:29.773319 12739 external_mini_cluster.cc:1428] Setting key 98bda324545c52930ef8bc4ba15af48a
Aug 07 22:51:29 dist-test-slave-tm1g krb5kdc[30700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:29.783542 30789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.772511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:58957 (local address 127.12.112.254:33547)
0807 22:51:29.772643 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:29.772648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:29.773513 (+ 865us) server_negotiation.cc:407] Connection header received
0807 22:51:29.775051 (+ 1538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:29.775054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:29.775106 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:29.775194 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:29.776286 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.776812 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.777887 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.778096 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.778167 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.780436 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:29.780439 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:29.780442 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:29.780464 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:29.781863 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:29.782275 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:29.782277 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:29.782278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:29.782407 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:29.782697 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:29.782699 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:29.782700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:29.782858 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:29.782940 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:29.783334 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 22:51:29.783427 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:51:29.784288 31244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.772828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:33547 (local address 127.12.112.195:58957)
0807 22:51:29.773343 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:29.773403 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:29.774864 (+ 1461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:29.775404 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:29.775411 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:29.775724 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:29.776163 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.776175 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.776915 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.776917 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.777788 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.777796 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.778212 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.778215 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.778414 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.778901 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:29.778916 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:29.780292 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:29.781956 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:29.781960 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:29.781969 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:29.782192 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:29.782487 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:29.782490 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:29.782491 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:29.782616 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:29.782942 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:29.782946 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:29.783145 (+ 199us) client_negotiation.cc:769] Sending connection context
0807 22:51:29.783288 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 22:51:29.783523 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":178,"threads_started":1}
I20260807 22:51:29.785331 31242 heartbeater.cc:347] Connected to a master server at 127.12.112.254:33547
I20260807 22:51:29.785564 31242 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:29.786010 31242 heartbeater.cc:511] Master 127.12.112.254:33547 requested a full tablet report, sending...
I20260807 22:51:29.787025 30749 ts_manager.cc:194] Registered new tserver with Master: ea5e05c4282c4b85a2ff383c51517b0f (127.12.112.195:38515)
I20260807 22:51:29.787597 30749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:58957
I20260807 22:51:29.798529 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:51:29.807679 30789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.800398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49348 (local address 127.12.112.254:33547)
0807 22:51:29.800541 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:29.800546 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:29.800710 (+ 164us) server_negotiation.cc:407] Connection header received
0807 22:51:29.800857 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:29.800861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:29.800912 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:29.801005 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:29.801730 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.802254 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.803114 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.803348 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.803460 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.804704 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:29.804708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:29.804710 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:29.804736 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:29.805917 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:29.806418 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:29.806422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:29.806424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:29.806516 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:29.806803 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:29.806806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:29.806808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:29.807034 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:29.807192 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:29.807418 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 22:51:29.807526 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 22:51:29.810712 30749 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:51:29.813814 30749 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:51:29.828409 31257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.823123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59472 (local address 127.12.112.194:38351)
0807 22:51:29.823558 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:29.823571 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:29.823595 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:51:29.823683 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:29.823692 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:29.823908 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:29.824088 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:29.824478 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.825671 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.827094 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.827699 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.827823 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.827956 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:29.828152 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 22:51:29.828245 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":88,"threads_started":1}
I20260807 22:51:29.828411 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.822915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:38351 (local address 127.0.0.1:59472)
0807 22:51:29.823338 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:29.823353 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:29.823446 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:29.824076 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:29.824082 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:29.824104 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:29.824319 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.824328 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.825828 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.825838 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.826975 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.826982 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.827813 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.827816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.827959 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.828006 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 22:51:29.828115 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 22:51:29.828257 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":29,"thread_start_us":91,"threads_started":1}
I20260807 22:51:29.828680 31258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.823285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48420 (local address 127.12.112.193:39713)
0807 22:51:29.823677 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:29.823692 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:29.823713 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:51:29.823785 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:29.823790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:29.823969 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:29.824299 (+ 330us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:29.824438 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.825216 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.826978 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.827848 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.828248 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.828380 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:29.828434 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 22:51:29.828533 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":111,"threads_started":1}
I20260807 22:51:29.828899 31254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.822206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:39713 (local address 127.0.0.1:48420)
0807 22:51:29.822507 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:29.822550 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:29.822674 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:29.824128 (+ 1454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:29.824131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:29.824154 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:29.824331 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.824338 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.825374 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.825380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.826843 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.826853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.827978 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.827981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.828058 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.828089 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 22:51:29.828134 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 22:51:29.828753 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":549,"spinlock_wait_cycles":4096,"thread_start_us":148,"threads_started":1}
I20260807 22:51:29.829667 31253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.822148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:38515 (local address 127.0.0.1:48770)
0807 22:51:29.822503 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:29.822549 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:29.822815 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:29.824260 (+ 1445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:29.824263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:29.824277 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:29.824384 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.824391 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.826369 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.826373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.827575 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:29.827586 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.829274 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.829279 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:29.829374 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.829396 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:51:29.829476 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:51:29.829543 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":4,"spinlock_wait_cycles":4224,"thread_start_us":98,"threads_started":1}
I20260807 22:51:29.829985 31256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:29.822879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48770 (local address 127.12.112.195:38515)
0807 22:51:29.823677 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:29.823690 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:29.823713 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:51:29.823785 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:29.823790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:29.823969 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:29.824117 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:29.824511 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.825680 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.827721 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:29.828986 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:29.829099 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:29.829208 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:29.829710 (+ 502us) server_negotiation.cc:299] Negotiation successful
0807 22:51:29.829805 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":202,"threads_started":1}
I20260807 22:51:29.832010 30880 tablet_service.cc:1467] Processing CreateTablet for tablet cf21c2d35ab149c69554514af4a37b5b (DEFAULT_TABLE table=test-table [id=6f473d384049430f8ccce053311bcd43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:29.832010 31026 tablet_service.cc:1467] Processing CreateTablet for tablet cf21c2d35ab149c69554514af4a37b5b (DEFAULT_TABLE table=test-table [id=6f473d384049430f8ccce053311bcd43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:29.832314 31172 tablet_service.cc:1467] Processing CreateTablet for tablet cf21c2d35ab149c69554514af4a37b5b (DEFAULT_TABLE table=test-table [id=6f473d384049430f8ccce053311bcd43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:29.833140 31026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf21c2d35ab149c69554514af4a37b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:29.833140 30880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf21c2d35ab149c69554514af4a37b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:29.833241 31172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf21c2d35ab149c69554514af4a37b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:29.839720 31259 tablet_bootstrap.cc:492] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: Bootstrap starting.
I20260807 22:51:29.840517 31260 tablet_bootstrap.cc:492] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: Bootstrap starting.
I20260807 22:51:29.840517 31261 tablet_bootstrap.cc:492] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2: Bootstrap starting.
I20260807 22:51:29.841887 31259 tablet_bootstrap.cc:654] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:29.842612 31261 tablet_bootstrap.cc:654] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:29.842612 31260 tablet_bootstrap.cc:654] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:29.843133 31259 log.cc:824] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:29.843905 31261 log.cc:824] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:29.843905 31260 log.cc:824] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:29.845485 31259 tablet_bootstrap.cc:492] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: No bootstrap required, opened a new log
I20260807 22:51:29.845660 31261 tablet_bootstrap.cc:492] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2: No bootstrap required, opened a new log
I20260807 22:51:29.845709 31259 ts_tablet_manager.cc:1397] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:51:29.845863 31261 ts_tablet_manager.cc:1397] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:51:29.846874 31260 tablet_bootstrap.cc:492] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: No bootstrap required, opened a new log
I20260807 22:51:29.847043 31260 ts_tablet_manager.cc:1397] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:51:29.848722 31261 raft_consensus.cc:348] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 38515 } } peers { permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 } } peers { permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 } }
I20260807 22:51:29.848953 31261 raft_consensus.cc:374] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:29.849007 31261 raft_consensus.cc:729] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1cc2de52fdc4ba7916b38ba588192e2, State: Initialized, Role: FOLLOWER
I20260807 22:51:29.849462 31261 consensus_queue.cc:260] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 38515 } } peers { permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 } } peers { permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 } }
I20260807 22:51:29.849545 31259 raft_consensus.cc:348] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 38515 } } peers { permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 } } peers { permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 } }
I20260807 22:51:29.849821 31259 raft_consensus.cc:374] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:29.849885 31259 raft_consensus.cc:729] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5e05c4282c4b85a2ff383c51517b0f, State: Initialized, Role: FOLLOWER
I20260807 22:51:29.850246 30950 heartbeater.cc:503] Master 127.12.112.254:33547 was elected leader, sending a full tablet report...
I20260807 22:51:29.850370 31259 consensus_queue.cc:260] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 38515 } } peers { permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 } } peers { permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 } }
I20260807 22:51:29.850510 31261 ts_tablet_manager.cc:1428] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:51:29.851060 31242 heartbeater.cc:503] Master 127.12.112.254:33547 was elected leader, sending a full tablet report...
I20260807 22:51:29.851342 31259 ts_tablet_manager.cc:1428] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:51:29.851989 31260 raft_consensus.cc:348] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 38515 } } peers { permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 } } peers { permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 } }
I20260807 22:51:29.852169 31260 raft_consensus.cc:374] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:29.852200 31260 raft_consensus.cc:729] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fe8ca778b90418d83ed4fd02054a6db, State: Initialized, Role: FOLLOWER
I20260807 22:51:29.852596 31260 consensus_queue.cc:260] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 38515 } } peers { permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 } } peers { permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 } }
I20260807 22:51:29.853204 31098 heartbeater.cc:503] Master 127.12.112.254:33547 was elected leader, sending a full tablet report...
I20260807 22:51:29.853430 31260 ts_tablet_manager.cc:1428] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260807 22:51:30.021687 31243 tablet.cc:2369] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:51:30.060351 31099 tablet.cc:2369] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:51:30.089119 31266 raft_consensus.cc:482] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:30.089334 31266 raft_consensus.cc:504] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 38515 } } peers { permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 } } peers { permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 } }
I20260807 22:51:30.090637 31266 leader_election.cc:288] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1cc2de52fdc4ba7916b38ba588192e2 (127.12.112.193:39713), 6fe8ca778b90418d83ed4fd02054a6db (127.12.112.194:38351)
W20260807 22:51:30.093305 30951 tablet.cc:2369] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:51:30.095191 31258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.091037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:54309 (local address 127.12.112.193:39713)
0807 22:51:30.091180 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:30.091184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:30.091203 (+ 19us) server_negotiation.cc:407] Connection header received
0807 22:51:30.091381 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:30.091387 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:30.091452 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:30.091526 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:30.091951 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.092587 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.093987 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.094621 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.094738 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:30.094788 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:30.094997 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 22:51:30.095068 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 22:51:30.095201 31244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.090950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:39713 (local address 127.12.112.195:54309)
0807 22:51:30.091087 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:30.091105 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:30.091208 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:30.091658 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:30.091664 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:30.091688 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:30.091824 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:30.091831 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.092714 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.092717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:30.093872 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:30.093883 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.094743 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.094747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:30.094857 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:30.094884 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:51:30.094970 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:51:30.095051 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 22:51:30.095659 31257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.091400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:33399 (local address 127.12.112.194:38351)
0807 22:51:30.091519 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:30.091523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:30.091757 (+ 234us) server_negotiation.cc:407] Connection header received
0807 22:51:30.091853 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:30.091855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:30.091909 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:30.092012 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:30.092276 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.093033 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.094437 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.094957 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.095043 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:30.095086 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:30.095449 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 22:51:30.095537 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:51:30.095849 30903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf21c2d35ab149c69554514af4a37b5b" candidate_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" is_pre_election: true
I20260807 22:51:30.096028 31268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.091250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:38351 (local address 127.12.112.195:33399)
0807 22:51:30.091655 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:30.091668 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:30.091761 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:30.092018 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:30.092020 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:30.092039 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:30.092161 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:30.092168 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.093150 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.093153 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:30.094259 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:30.094271 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.095173 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.095175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:30.095291 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:30.095314 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:51:30.095812 (+ 498us) client_negotiation.cc:240] Negotiation successful
0807 22:51:30.095895 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":140,"threads_started":1}
I20260807 22:51:30.096155 30903 raft_consensus.cc:2454] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5e05c4282c4b85a2ff383c51517b0f in term 0.
I20260807 22:51:30.096645 31049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf21c2d35ab149c69554514af4a37b5b" candidate_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fe8ca778b90418d83ed4fd02054a6db" is_pre_election: true
I20260807 22:51:30.096650 31124 leader_election.cc:302] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1cc2de52fdc4ba7916b38ba588192e2, ea5e05c4282c4b85a2ff383c51517b0f; no voters:
I20260807 22:51:30.096942 31049 raft_consensus.cc:2454] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5e05c4282c4b85a2ff383c51517b0f in term 0.
I20260807 22:51:30.096943 31266 raft_consensus.cc:2781] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:51:30.097033 31266 raft_consensus.cc:482] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:51:30.097076 31266 raft_consensus.cc:3037] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:30.098241 31266 raft_consensus.cc:504] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 38515 } } peers { permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 } } peers { permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 } }
I20260807 22:51:30.098666 31266 leader_election.cc:288] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [CANDIDATE]: Term 1 election: Requested vote from peers d1cc2de52fdc4ba7916b38ba588192e2 (127.12.112.193:39713), 6fe8ca778b90418d83ed4fd02054a6db (127.12.112.194:38351)
I20260807 22:51:30.098980 30903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf21c2d35ab149c69554514af4a37b5b" candidate_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1cc2de52fdc4ba7916b38ba588192e2"
I20260807 22:51:30.099114 30903 raft_consensus.cc:3037] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:30.099156 31049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf21c2d35ab149c69554514af4a37b5b" candidate_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fe8ca778b90418d83ed4fd02054a6db"
I20260807 22:51:30.099262 31049 raft_consensus.cc:3037] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:30.100406 30903 raft_consensus.cc:2454] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5e05c4282c4b85a2ff383c51517b0f in term 1.
I20260807 22:51:30.100494 31049 raft_consensus.cc:2454] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5e05c4282c4b85a2ff383c51517b0f in term 1.
I20260807 22:51:30.100800 31124 leader_election.cc:302] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fe8ca778b90418d83ed4fd02054a6db, ea5e05c4282c4b85a2ff383c51517b0f; no voters:
I20260807 22:51:30.101009 31266 raft_consensus.cc:2781] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:30.101229 31266 raft_consensus.cc:686] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 1 LEADER]: Becoming Leader. State: Replica: ea5e05c4282c4b85a2ff383c51517b0f, State: Running, Role: LEADER
I20260807 22:51:30.101552 31266 consensus_queue.cc:237] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 38515 } } peers { permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 } } peers { permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 } }
I20260807 22:51:30.104610 30748 catalog_manager.cc:5495] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5e05c4282c4b85a2ff383c51517b0f (127.12.112.195). New cstate: current_term: 1 leader_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5e05c4282c4b85a2ff383c51517b0f" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 38515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 } health_report { overall_health: UNKNOWN } } }
I20260807 22:51:30.117751 31256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.114480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48782 (local address 127.12.112.195:38515)
0807 22:51:30.114591 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:30.114594 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:30.114633 (+ 39us) server_negotiation.cc:407] Connection header received
0807 22:51:30.114777 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:30.114781 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:30.114828 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:30.114915 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:51:30.115122 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.115599 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.116402 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.116608 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.116687 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:30.117045 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:51:30.117416 (+ 371us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:51:30.117505 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:30.117602 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 22:51:30.117644 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:51:30.122987 31049 raft_consensus.cc:1261] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db [term 1 FOLLOWER]: Refusing update from remote peer ea5e05c4282c4b85a2ff383c51517b0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:30.123072 30903 raft_consensus.cc:1261] T cf21c2d35ab149c69554514af4a37b5b P d1cc2de52fdc4ba7916b38ba588192e2 [term 1 FOLLOWER]: Refusing update from remote peer ea5e05c4282c4b85a2ff383c51517b0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:30.123680 31266 consensus_queue.cc:1035] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fe8ca778b90418d83ed4fd02054a6db" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:30.123850 31269 consensus_queue.cc:1035] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1cc2de52fdc4ba7916b38ba588192e2" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:30.131376 31275 mvcc.cc:205] Tried to move back new op lower bound from 7316042097137369088 to 7316042097058734080. Current Snapshot: MvccSnapshot[applied={T|T < 7316042097137369088}]
I20260807 22:51:30.132766 31274 mvcc.cc:205] Tried to move back new op lower bound from 7316042097137369088 to 7316042097058734080. Current Snapshot: MvccSnapshot[applied={T|T < 7316042097137369088}]
I20260807 22:51:30.139791 30747 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:30.139972 30747 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:30.142426 30747 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb5c05e81e4649ecaf47a60b9f753030: Sending DeleteTablet for 3 replicas of tablet cf21c2d35ab149c69554514af4a37b5b
I20260807 22:51:30.143286 31026 tablet_service.cc:1514] Processing DeleteTablet for tablet cf21c2d35ab149c69554514af4a37b5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:30 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:59472
I20260807 22:51:30.143306 31172 tablet_service.cc:1514] Processing DeleteTablet for tablet cf21c2d35ab149c69554514af4a37b5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:30 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:48770
I20260807 22:51:30.143306 30880 tablet_service.cc:1514] Processing DeleteTablet for tablet cf21c2d35ab149c69554514af4a37b5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:30 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:48420
I20260807 22:51:30.143790 31285 tablet_replica.cc:330] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: stopping tablet replica
I20260807 22:51:30.144100 31285 raft_consensus.cc:2229] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:51:30.144395 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 30815
I20260807 22:51:30.144409 31285 raft_consensus.cc:2258] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:30.143908 31283 tablet_replica.cc:330] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: stopping tablet replica
I20260807 22:51:30.147850 31283 raft_consensus.cc:2229] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:51:30.148212 31283 raft_consensus.cc:2258] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:30.148772 31285 ts_tablet_manager.cc:1905] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:30.149699 31283 ts_tablet_manager.cc:1905] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:30.151897 31285 ts_tablet_manager.cc:1918] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:30.151997 31285 log.cc:1196] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/cf21c2d35ab149c69554514af4a37b5b
I20260807 22:51:30.152307 31285 ts_tablet_manager.cc:1939] T cf21c2d35ab149c69554514af4a37b5b P 6fe8ca778b90418d83ed4fd02054a6db: Deleting consensus metadata
I20260807 22:51:30.153365 31283 ts_tablet_manager.cc:1918] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:30.153469 30736 catalog_manager.cc:4841] TS 6fe8ca778b90418d83ed4fd02054a6db (127.12.112.194:38351): tablet cf21c2d35ab149c69554514af4a37b5b (table test-table [id=6f473d384049430f8ccce053311bcd43]) successfully deleted
I20260807 22:51:30.153527 31283 log.cc:1196] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/cf21c2d35ab149c69554514af4a37b5b
I20260807 22:51:30.153891 31283 ts_tablet_manager.cc:1939] T cf21c2d35ab149c69554514af4a37b5b P ea5e05c4282c4b85a2ff383c51517b0f: Deleting consensus metadata
I20260807 22:51:30.155088 30734 catalog_manager.cc:4841] TS ea5e05c4282c4b85a2ff383c51517b0f (127.12.112.195:38515): tablet cf21c2d35ab149c69554514af4a37b5b (table test-table [id=6f473d384049430f8ccce053311bcd43]) successfully deleted
W20260807 22:51:30.155329 30736 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:39713 (error 108)
I20260807 22:51:30.156337 31253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.156015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:39713 (local address 127.0.0.1:48436)
0807 22:51:30.156158 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:30.156237 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:39713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 22:51:30.156431 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 30955
W20260807 22:51:30.156541 30736 catalog_manager.cc:4584] TS d1cc2de52fdc4ba7916b38ba588192e2 (127.12.112.193:39713): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cf21c2d35ab149c69554514af4a37b5b: Network error: Client connection negotiation failed: client connection to 127.12.112.193:39713: connect: Connection refused (error 111)
I20260807 22:51:30.163623 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 31103
I20260807 22:51:30.170576 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 30716
2026-08-07T22:51:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2455 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T22:51:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:30Z Disabled control of system clock
I20260807 22:51:30.201864 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:41125
--webserver_interface=127.12.112.254
--webserver_port=0
--builtin_ntp_servers=127.12.112.212:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:41125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:51:30.310539 31290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:30.310770 31290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:30.310803 31290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:30.314672 31290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:30.314720 31290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:30.314736 31290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:30.314754 31290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:30.314769 31290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:30.319406 31290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:41125
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:41125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:30.320335 31290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:30.321581 31290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:30.329826 31295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:30.329932 31290 server_base.cc:1034] running on GCE node
W20260807 22:51:30.329806 31296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:30.330068 31298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:30.330641 31290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:30.331666 31290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:30.332828 31290 hybrid_clock.cc:648] HybridClock initialized: now 1786143090332807 us; error 34 us; skew 500 ppm
I20260807 22:51:30.334594 31290 webserver.cc:460] Webserver started at http://127.12.112.254:41823/ using document root <none> and password file <none>
I20260807 22:51:30.335095 31290 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:30.335151 31290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:30.335306 31290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:30.337229 31290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "2a8b747824d94069a342f5085cf5cf1e"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "20e80f2338500aa9e880301d617e47d3"
server_key_iv: "f1e2c37c2336bf97a1f7b00db3b82f2e"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.337728 31290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "2a8b747824d94069a342f5085cf5cf1e"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "20e80f2338500aa9e880301d617e47d3"
server_key_iv: "f1e2c37c2336bf97a1f7b00db3b82f2e"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.341112 31290 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:51:30.343389 31304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:30.344539 31290 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:51:30.344662 31290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "2a8b747824d94069a342f5085cf5cf1e"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "20e80f2338500aa9e880301d617e47d3"
server_key_iv: "f1e2c37c2336bf97a1f7b00db3b82f2e"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.344763 31290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:30.369247 31290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:30.369886 31290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:30.370087 31290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:30.376906 31290 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:41125
I20260807 22:51:30.376914 31360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:41125 every 8 connection(s)
I20260807 22:51:30.377792 31290 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:30.380722 31361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:30.385980 31361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e: Bootstrap starting.
I20260807 22:51:30.387476 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 31290
I20260807 22:51:30.387609 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:30.387902 12739 external_mini_cluster.cc:1428] Setting key 0ac22509127a2083c2aa1a374b546df9
I20260807 22:51:30.388692 31361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:30.389540 31361 log.cc:824] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:30.391459 31361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e: No bootstrap required, opened a new log
I20260807 22:51:30.395488 31361 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8b747824d94069a342f5085cf5cf1e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 41125 } }
I20260807 22:51:30.395684 31361 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:30.395748 31361 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a8b747824d94069a342f5085cf5cf1e, State: Initialized, Role: FOLLOWER
I20260807 22:51:30.396173 31361 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8b747824d94069a342f5085cf5cf1e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 41125 } }
I20260807 22:51:30.396324 31361 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:30.396412 31361 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:30.396529 31361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:30.397342 31361 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8b747824d94069a342f5085cf5cf1e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 41125 } }
I20260807 22:51:30.397369 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.388995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50022 (local address 127.12.112.254:41125)
0807 22:51:30.389588 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:30.389622 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:30.389666 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:51:30.390513 (+ 847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:30.390531 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:30.390830 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:30.391140 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:30.391588 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.392532 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.393839 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.394525 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.394686 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:30.395548 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:30.395554 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:30.395576 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:30.396073 (+ 497us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:30.396139 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:30.396160 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:30.396264 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:30.396436 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 22:51:30.396706 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":118,"threads_started":1}
I20260807 22:51:30.397737 31361 leader_election.cc:302] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a8b747824d94069a342f5085cf5cf1e; no voters:
I20260807 22:51:30.398056 31361 leader_election.cc:288] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:30.398157 31367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:30.398449 31367 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [term 1 LEADER]: Becoming Leader. State: Replica: 2a8b747824d94069a342f5085cf5cf1e, State: Running, Role: LEADER
I20260807 22:51:30.398731 31367 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8b747824d94069a342f5085cf5cf1e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 41125 } }
I20260807 22:51:30.400138 31369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a8b747824d94069a342f5085cf5cf1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8b747824d94069a342f5085cf5cf1e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 41125 } } }
I20260807 22:51:30.400199 31361 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:30.400264 31369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:30.400285 31368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a8b747824d94069a342f5085cf5cf1e. Latest consensus state: current_term: 1 leader_uuid: "2a8b747824d94069a342f5085cf5cf1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8b747824d94069a342f5085cf5cf1e" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 41125 } } }
I20260807 22:51:30.400374 31368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:30.400665 31371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:30.403760 31371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:30.408604 31371 catalog_manager.cc:1347] Generated new cluster ID: 64589d780cad40e1ae2366fcf6aff02e
I20260807 22:51:30.408665 31371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:30.414506 31371 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:30.415576 31371 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:30.423153 31371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e: Generated new TSK 0
I20260807 22:51:30.423866 31371 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:30.434962 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:41125
--builtin_ntp_servers=127.12.112.212:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:51:30.544384 31387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:30.544611 31387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:30.544647 31387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:30.548642 31387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:30.548687 31387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:30.548776 31387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:51:30.553434 31387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:41125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:30.554453 31387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:30.555752 31387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:30.565217 31393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:30.565279 31392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:30.565327 31387 server_base.cc:1034] running on GCE node
W20260807 22:51:30.565200 31395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:30.565828 31387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:30.566498 31387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:30.567679 31387 hybrid_clock.cc:648] HybridClock initialized: now 1786143090567670 us; error 25 us; skew 500 ppm
I20260807 22:51:30.569295 31387 webserver.cc:460] Webserver started at http://127.12.112.193:40471/ using document root <none> and password file <none>
I20260807 22:51:30.569842 31387 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:30.569931 31387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:30.570179 31387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:30.572335 31387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "447eef80b79d656f234455fd49df03b4"
server_key_iv: "b244ade0e9c53900abbea1cf5b2c6ac5"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.572894 31387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "447eef80b79d656f234455fd49df03b4"
server_key_iv: "b244ade0e9c53900abbea1cf5b2c6ac5"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.576331 31387 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:51:30.578575 31401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:30.579686 31387 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:51:30.579815 31387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "447eef80b79d656f234455fd49df03b4"
server_key_iv: "b244ade0e9c53900abbea1cf5b2c6ac5"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.579926 31387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:30.617506 31387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:30.618170 31387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:30.618417 31387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:30.618986 31387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:30.619887 31387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:30.619956 31387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:30.620028 31387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:30.620079 31387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:30.629171 31387 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:32807
I20260807 22:51:30.629211 31522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:32807 every 8 connection(s)
I20260807 22:51:30.630026 31387 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:51:30.631969 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 31387
I20260807 22:51:30.632097 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:51:30.632385 12739 external_mini_cluster.cc:1428] Setting key 6e54c5aa9db74f45096e7fd763f5299e
I20260807 22:51:30.634270 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:41125
--builtin_ntp_servers=127.12.112.212:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:51:30.639425 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.631805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:56837 (local address 127.12.112.254:41125)
0807 22:51:30.631976 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:30.631982 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:30.633109 (+ 1127us) server_negotiation.cc:407] Connection header received
0807 22:51:30.634581 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:30.634587 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:30.634649 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:30.634738 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:30.635618 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.636312 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.637451 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.637684 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.637796 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:30.638931 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:30.638935 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:30.638937 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:30.638950 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:30.638971 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:30.638987 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:30.639061 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:30.639219 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 22:51:30.639277 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 22:51:30.640363 31525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.632240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:41125 (local address 127.12.112.193:56837)
0807 22:51:30.632969 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:30.633021 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:30.634280 (+ 1259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:30.634928 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:30.634934 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:30.635014 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:30.635477 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:30.635489 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.636444 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.636448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:30.637321 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:30.637330 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.637834 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.637838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:30.638003 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:30.638684 (+ 681us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:51:30.638686 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:30.638724 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:51:30.638782 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:30.639076 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:30.639094 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:30.639098 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:51:30.639219 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 22:51:30.639475 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":142,"threads_started":1}
I20260807 22:51:30.641685 31523 heartbeater.cc:347] Connected to a master server at 127.12.112.254:41125
I20260807 22:51:30.641909 31523 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:30.642458 31523 heartbeater.cc:511] Master 127.12.112.254:41125 requested a full tablet report, sending...
I20260807 22:51:30.643899 31323 ts_manager.cc:194] Registered new tserver with Master: e04b9e4af01c43f3ba3471aa81bd1b1d (127.12.112.193:32807)
I20260807 22:51:30.645004 31323 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.193:56837
W20260807 22:51:30.743552 31526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:30.743813 31526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:30.743887 31526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:30.747877 31526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:30.747944 31526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:30.748034 31526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:51:30.752719 31526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:41125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:30.753715 31526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:30.755366 31526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:30.764889 31532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:30.764961 31534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:30.764905 31531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:30.765012 31526 server_base.cc:1034] running on GCE node
I20260807 22:51:30.765506 31526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:30.766119 31526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:30.767306 31526 hybrid_clock.cc:648] HybridClock initialized: now 1786143090767274 us; error 83 us; skew 500 ppm
I20260807 22:51:30.769064 31526 webserver.cc:460] Webserver started at http://127.12.112.194:39627/ using document root <none> and password file <none>
I20260807 22:51:30.769675 31526 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:30.769773 31526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:30.770004 31526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:30.772059 31526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "4dce4b43e4344d17ba9e4fea13af34a4"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "e5fa9dc780458ee9b2e5db79c6ace6ee"
server_key_iv: "9da18294958af3dac3602e34a918d7dc"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.772722 31526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "4dce4b43e4344d17ba9e4fea13af34a4"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "e5fa9dc780458ee9b2e5db79c6ace6ee"
server_key_iv: "9da18294958af3dac3602e34a918d7dc"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.776319 31526 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:51:30.778607 31540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:30.779748 31526 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:51:30.779888 31526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "4dce4b43e4344d17ba9e4fea13af34a4"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "e5fa9dc780458ee9b2e5db79c6ace6ee"
server_key_iv: "9da18294958af3dac3602e34a918d7dc"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.779994 31526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:30.800137 31526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:30.800984 31526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:30.801182 31526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:30.801800 31526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:30.802825 31526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:30.802896 31526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:30.802963 31526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:30.803009 31526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:30.811700 31526 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:35221
I20260807 22:51:30.811731 31661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:35221 every 8 connection(s)
I20260807 22:51:30.812569 31526 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:51:30.821113 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.814262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:55663 (local address 127.12.112.254:41125)
0807 22:51:30.814423 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:30.814427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:30.815449 (+ 1022us) server_negotiation.cc:407] Connection header received
0807 22:51:30.816766 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:30.816769 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:30.816819 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:30.816903 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:30.817716 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.818276 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.819411 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.819643 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.819725 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:30.820708 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:30.820711 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:30.820713 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:30.820726 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:30.820745 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:30.820754 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:30.820815 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:30.820948 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 22:51:30.820997 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:51:30.821341 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 31526
I20260807 22:51:30.821483 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:51:30.821802 12739 external_mini_cluster.cc:1428] Setting key cfd0b7edaa6fa4c398cff153ec86ccc4
I20260807 22:51:30.822154 31664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:30.814664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:41125 (local address 127.12.112.194:55663)
0807 22:51:30.815292 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:30.815331 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:30.816576 (+ 1245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:30.817045 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:30.817051 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:30.817130 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:30.817589 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:30.817601 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.818442 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.818445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:30.819293 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:30.819301 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:30.819779 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:30.819782 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:30.819913 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:30.820471 (+ 558us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:51:30.820472 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:30.820509 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:51:30.820567 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:30.820830 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:30.820836 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:30.820840 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:51:30.820928 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:51:30.821188 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":117,"threads_started":1}
I20260807 22:51:30.823419 31662 heartbeater.cc:347] Connected to a master server at 127.12.112.254:41125
I20260807 22:51:30.823642 31662 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:30.823982 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:41125
--builtin_ntp_servers=127.12.112.212:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:51:30.824240 31662 heartbeater.cc:511] Master 127.12.112.254:41125 requested a full tablet report, sending...
I20260807 22:51:30.825361 31323 ts_manager.cc:194] Registered new tserver with Master: 4dce4b43e4344d17ba9e4fea13af34a4 (127.12.112.194:35221)
I20260807 22:51:30.826046 31323 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.194:55663
W20260807 22:51:30.935432 31665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:30.935688 31665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:30.935791 31665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:30.939745 31665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:30.939815 31665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:30.939904 31665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:51:30.944572 31665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:41125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:30.945564 31665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:30.946939 31665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:30.956609 31673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:30.956704 31665 server_base.cc:1034] running on GCE node
W20260807 22:51:30.956614 31671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:30.956622 31670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:30.957301 31665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:30.957888 31665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:30.959067 31665 hybrid_clock.cc:648] HybridClock initialized: now 1786143090959049 us; error 57 us; skew 500 ppm
I20260807 22:51:30.960930 31665 webserver.cc:460] Webserver started at http://127.12.112.195:39751/ using document root <none> and password file <none>
I20260807 22:51:30.961479 31665 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:30.961570 31665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:30.961786 31665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:30.963796 31665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "9c703c4d6a17414da9a21bd1e6473656"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "fad682a46e4241ececae447244ac5e6b"
server_key_iv: "7539dd9ca2dc8e2e18a3bf00b70b387e"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.964336 31665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "9c703c4d6a17414da9a21bd1e6473656"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "fad682a46e4241ececae447244ac5e6b"
server_key_iv: "7539dd9ca2dc8e2e18a3bf00b70b387e"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.967825 31665 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 22:51:30.970146 31680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:30.971356 31665 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260807 22:51:30.971506 31665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "9c703c4d6a17414da9a21bd1e6473656"
format_stamp: "Formatted at 2026-08-07 22:51:30 on dist-test-slave-tm1g"
server_key: "fad682a46e4241ececae447244ac5e6b"
server_key_iv: "7539dd9ca2dc8e2e18a3bf00b70b387e"
server_key_version: "encryptionkey@0"
I20260807 22:51:30.971613 31665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:30.998975 31665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:30.999629 31665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:30.999820 31665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:31.000435 31665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:31.001598 31665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:31.001673 31665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:31.001726 31665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:31.001757 31665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:31.010524 31665 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:33357
I20260807 22:51:31.010555 31802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:33357 every 8 connection(s)
I20260807 22:51:31.011457 31665 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:51:31.020447 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.013176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:53689 (local address 127.12.112.254:41125)
0807 22:51:31.013323 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:31.013328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:31.014323 (+ 995us) server_negotiation.cc:407] Connection header received
0807 22:51:31.015705 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:31.015709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:31.015769 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:31.015877 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:31.016731 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.017272 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.018475 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.018709 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.018833 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.019866 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:31.019874 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:31.019876 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:31.019887 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:31.019976 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:31.019985 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:31.020075 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:31.020236 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 22:51:31.020301 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:51:31.021263 31805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.013548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:41125 (local address 127.12.112.195:53689)
0807 22:51:31.014162 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:31.014201 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:31.015501 (+ 1300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:31.016044 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:31.016050 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:31.016127 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:31.016593 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.016604 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.017414 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.017418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.018290 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.018354 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.018861 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.018866 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.019034 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.019609 (+ 575us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:51:31.019611 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:31.019648 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:51:31.019704 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:31.020076 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:31.020088 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:31.020096 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:51:31.020232 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 22:51:31.020505 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":117,"threads_started":1}
I20260807 22:51:31.021240 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 31665
I20260807 22:51:31.021401 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:51:31.021745 12739 external_mini_cluster.cc:1428] Setting key d0fca88e44686bc6c6846e586e867441
I20260807 22:51:31.022576 31803 heartbeater.cc:347] Connected to a master server at 127.12.112.254:41125
I20260807 22:51:31.022806 31803 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:31.023360 31803 heartbeater.cc:511] Master 127.12.112.254:41125 requested a full tablet report, sending...
I20260807 22:51:31.024339 31323 ts_manager.cc:194] Registered new tserver with Master: 9c703c4d6a17414da9a21bd1e6473656 (127.12.112.195:33357)
I20260807 22:51:31.024897 31323 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.195:53689
I20260807 22:51:31.035826 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:51:31.041659 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.037829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50030 (local address 127.12.112.254:41125)
0807 22:51:31.037989 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:31.037994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:31.038148 (+ 154us) server_negotiation.cc:407] Connection header received
0807 22:51:31.038292 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:31.038295 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:31.038365 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:31.038460 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:31.038762 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.039283 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.040137 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.040367 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.040480 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.041227 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:31.041231 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:31.041233 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:31.041252 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:31.041269 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:31.041277 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:31.041356 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:31.041464 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 22:51:31.041518 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 22:51:31.044279 31323 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:51:31.047271 31323 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:51:31.061658 31818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.055737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:33357 (local address 127.0.0.1:39512)
0807 22:51:31.056272 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:31.056324 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:31.056474 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:31.057205 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:31.057210 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:31.057233 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:31.057377 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.057388 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.058877 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.058881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.060256 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.060268 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.061087 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.061090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.061207 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.061243 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 22:51:31.061354 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:51:31.061473 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":97,"spinlock_wait_cycles":27392,"thread_start_us":109,"threads_started":1}
I20260807 22:51:31.061656 31819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.056229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39512 (local address 127.12.112.195:33357)
0807 22:51:31.056713 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:31.056727 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:31.056753 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:51:31.056831 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:31.056837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:31.057039 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:31.057192 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:31.057516 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.058760 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.060420 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.060951 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.061098 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.061282 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:31.061380 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 22:51:31.061473 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":158,"threads_started":1}
I20260807 22:51:31.061691 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.055483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:32807 (local address 127.0.0.1:49044)
0807 22:51:31.056274 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:31.056324 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:31.056474 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:31.057439 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:31.057442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:31.057459 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:31.057583 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.057590 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.058947 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.058950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.060148 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.060158 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.061259 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.061262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.061346 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.061368 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:51:31.061433 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 22:51:31.061505 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"mutex_wait_us":8,"spinlock_wait_cycles":11392,"thread_start_us":85,"threads_started":1}
I20260807 22:51:31.062242 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.055715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33028 (local address 127.12.112.194:35221)
0807 22:51:31.056786 (+ 1071us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:31.056798 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:31.056955 (+ 157us) server_negotiation.cc:407] Connection header received
0807 22:51:31.057039 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:31.057044 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:31.057212 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:31.057356 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:31.057763 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.058573 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.060393 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.061149 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.061266 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.061433 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:31.061979 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 22:51:31.062077 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":964,"thread_start_us":92,"threads_started":1}
I20260807 22:51:31.062548 31817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.055483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:35221 (local address 127.0.0.1:33028)
0807 22:51:31.056789 (+ 1306us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:31.056802 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:31.056893 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:31.057515 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:31.057517 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:31.057531 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:31.057641 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.057648 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.058684 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.058689 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.060256 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.060268 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.061492 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.061496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.061578 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.061599 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:51:31.061663 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 22:51:31.062430 (+ 767us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1254,"mutex_wait_us":646,"thread_start_us":84,"threads_started":1}
I20260807 22:51:31.062541 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.055647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49044 (local address 127.12.112.193:32807)
0807 22:51:31.056996 (+ 1349us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:31.057007 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:31.057036 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:51:31.057095 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:31.057099 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:31.057290 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:31.057455 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:31.057707 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.058849 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.060273 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.061093 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.062049 (+ 956us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.062202 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:31.062251 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 22:51:31.062380 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1238,"thread_start_us":168,"threads_started":1}
I20260807 22:51:31.064641 31733 tablet_service.cc:1467] Processing CreateTablet for tablet b94e9e739fec44d0a5b1fc4ded1878b1 (DEFAULT_TABLE table=test-table [id=7a45db04f7fe4932bb4200d694fb2857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:31.064733 31590 tablet_service.cc:1467] Processing CreateTablet for tablet b94e9e739fec44d0a5b1fc4ded1878b1 (DEFAULT_TABLE table=test-table [id=7a45db04f7fe4932bb4200d694fb2857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:31.065662 31733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b94e9e739fec44d0a5b1fc4ded1878b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:31.065694 31590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b94e9e739fec44d0a5b1fc4ded1878b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:31.067934 31452 tablet_service.cc:1467] Processing CreateTablet for tablet b94e9e739fec44d0a5b1fc4ded1878b1 (DEFAULT_TABLE table=test-table [id=7a45db04f7fe4932bb4200d694fb2857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:31.068962 31452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b94e9e739fec44d0a5b1fc4ded1878b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:31.071689 31820 tablet_bootstrap.cc:492] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: Bootstrap starting.
I20260807 22:51:31.074546 31820 tablet_bootstrap.cc:654] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:31.075325 31820 log.cc:824] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:31.075505 31822 tablet_bootstrap.cc:492] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d: Bootstrap starting.
I20260807 22:51:31.076066 31821 tablet_bootstrap.cc:492] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: Bootstrap starting.
I20260807 22:51:31.077162 31820 tablet_bootstrap.cc:492] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: No bootstrap required, opened a new log
I20260807 22:51:31.077366 31820 ts_tablet_manager.cc:1397] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 22:51:31.077710 31822 tablet_bootstrap.cc:654] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:31.078075 31821 tablet_bootstrap.cc:654] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:31.078576 31822 log.cc:824] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:31.078877 31821 log.cc:824] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:31.080678 31822 tablet_bootstrap.cc:492] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d: No bootstrap required, opened a new log
I20260807 22:51:31.080886 31822 ts_tablet_manager.cc:1397] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:51:31.081073 31821 tablet_bootstrap.cc:492] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: No bootstrap required, opened a new log
I20260807 22:51:31.081259 31821 ts_tablet_manager.cc:1397] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 22:51:31.081624 31820 raft_consensus.cc:348] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 } } peers { permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 } } peers { permanent_uuid: "9c703c4d6a17414da9a21bd1e6473656" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 33357 } }
I20260807 22:51:31.081915 31820 raft_consensus.cc:374] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:31.081975 31820 raft_consensus.cc:729] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dce4b43e4344d17ba9e4fea13af34a4, State: Initialized, Role: FOLLOWER
I20260807 22:51:31.082440 31820 consensus_queue.cc:260] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 } } peers { permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 } } peers { permanent_uuid: "9c703c4d6a17414da9a21bd1e6473656" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 33357 } }
I20260807 22:51:31.083227 31662 heartbeater.cc:503] Master 127.12.112.254:41125 was elected leader, sending a full tablet report...
I20260807 22:51:31.083515 31820 ts_tablet_manager.cc:1428] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260807 22:51:31.084892 31822 raft_consensus.cc:348] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 } } peers { permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 } } peers { permanent_uuid: "9c703c4d6a17414da9a21bd1e6473656" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 33357 } }
I20260807 22:51:31.085105 31822 raft_consensus.cc:374] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:31.085160 31822 raft_consensus.cc:729] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04b9e4af01c43f3ba3471aa81bd1b1d, State: Initialized, Role: FOLLOWER
I20260807 22:51:31.085577 31822 consensus_queue.cc:260] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 } } peers { permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 } } peers { permanent_uuid: "9c703c4d6a17414da9a21bd1e6473656" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 33357 } }
I20260807 22:51:31.085748 31821 raft_consensus.cc:348] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 } } peers { permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 } } peers { permanent_uuid: "9c703c4d6a17414da9a21bd1e6473656" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 33357 } }
I20260807 22:51:31.086035 31821 raft_consensus.cc:374] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:31.086091 31821 raft_consensus.cc:729] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c703c4d6a17414da9a21bd1e6473656, State: Initialized, Role: FOLLOWER
I20260807 22:51:31.086553 31822 ts_tablet_manager.cc:1428] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:51:31.086529 31821 consensus_queue.cc:260] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 } } peers { permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 } } peers { permanent_uuid: "9c703c4d6a17414da9a21bd1e6473656" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 33357 } }
I20260807 22:51:31.086887 31523 heartbeater.cc:503] Master 127.12.112.254:41125 was elected leader, sending a full tablet report...
I20260807 22:51:31.087342 31803 heartbeater.cc:503] Master 127.12.112.254:41125 was elected leader, sending a full tablet report...
I20260807 22:51:31.087376 31821 ts_tablet_manager.cc:1428] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260807 22:51:31.131258 31524 tablet.cc:2369] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:51:31.262490 31804 tablet.cc:2369] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:51:31.283421 31828 raft_consensus.cc:482] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:31.283690 31828 raft_consensus.cc:504] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 } } peers { permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 } } peers { permanent_uuid: "9c703c4d6a17414da9a21bd1e6473656" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 33357 } }
I20260807 22:51:31.284996 31828 leader_election.cc:288] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04b9e4af01c43f3ba3471aa81bd1b1d (127.12.112.193:32807), 4dce4b43e4344d17ba9e4fea13af34a4 (127.12.112.194:35221)
I20260807 22:51:31.289566 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.285371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:32951 (local address 127.12.112.194:35221)
0807 22:51:31.285497 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:31.285503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:31.286023 (+ 520us) server_negotiation.cc:407] Connection header received
0807 22:51:31.286106 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:31.286109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:31.286173 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:31.286253 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:31.286559 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.287243 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.288583 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.288980 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.289110 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.289161 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:31.289364 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 22:51:31.289431 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:51:31.289610 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.285271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:35221 (local address 127.12.112.195:32951)
0807 22:51:31.285919 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:31.285932 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:31.286020 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:31.286268 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:31.286270 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:31.286286 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:31.286446 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.286451 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.287332 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.287335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.288485 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.288491 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.289111 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.289115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.289233 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.289252 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 22:51:31.289346 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:51:31.289417 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"mutex_wait_us":278,"thread_start_us":139,"threads_started":1}
I20260807 22:51:31.289614 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.285471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:59287 (local address 127.12.112.193:32807)
0807 22:51:31.285623 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:31.285629 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:31.285649 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:51:31.285714 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:31.285719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:31.285777 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:31.285874 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:31.286220 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.287045 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.288643 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.289037 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.289172 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.289220 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:31.289421 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 22:51:31.289492 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:51:31.289614 31805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.285271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:32807 (local address 127.12.112.195:59287)
0807 22:51:31.285437 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:31.285454 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:31.285569 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:31.285901 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:31.285911 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:31.285932 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:31.286088 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.286098 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.287154 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.287156 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.288468 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:31.288479 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.289172 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.289176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:31.289284 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.289311 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:51:31.289397 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:51:31.289470 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":57}
I20260807 22:51:31.290345 31610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b94e9e739fec44d0a5b1fc4ded1878b1" candidate_uuid: "9c703c4d6a17414da9a21bd1e6473656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" is_pre_election: true
I20260807 22:51:31.290654 31473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b94e9e739fec44d0a5b1fc4ded1878b1" candidate_uuid: "9c703c4d6a17414da9a21bd1e6473656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" is_pre_election: true
I20260807 22:51:31.290685 31610 raft_consensus.cc:2454] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c703c4d6a17414da9a21bd1e6473656 in term 0.
I20260807 22:51:31.290921 31473 raft_consensus.cc:2454] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c703c4d6a17414da9a21bd1e6473656 in term 0.
I20260807 22:51:31.291198 31684 leader_election.cc:302] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dce4b43e4344d17ba9e4fea13af34a4, 9c703c4d6a17414da9a21bd1e6473656; no voters:
I20260807 22:51:31.291499 31828 raft_consensus.cc:2781] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:51:31.291603 31828 raft_consensus.cc:482] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:51:31.291661 31828 raft_consensus.cc:3037] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:31.292701 31828 raft_consensus.cc:504] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 } } peers { permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 } } peers { permanent_uuid: "9c703c4d6a17414da9a21bd1e6473656" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 33357 } }
I20260807 22:51:31.293073 31828 leader_election.cc:288] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [CANDIDATE]: Term 1 election: Requested vote from peers e04b9e4af01c43f3ba3471aa81bd1b1d (127.12.112.193:32807), 4dce4b43e4344d17ba9e4fea13af34a4 (127.12.112.194:35221)
I20260807 22:51:31.293366 31473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b94e9e739fec44d0a5b1fc4ded1878b1" candidate_uuid: "9c703c4d6a17414da9a21bd1e6473656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d"
I20260807 22:51:31.293452 31610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b94e9e739fec44d0a5b1fc4ded1878b1" candidate_uuid: "9c703c4d6a17414da9a21bd1e6473656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dce4b43e4344d17ba9e4fea13af34a4"
I20260807 22:51:31.293519 31473 raft_consensus.cc:3037] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:31.293594 31610 raft_consensus.cc:3037] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:31.294636 31473 raft_consensus.cc:2454] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c703c4d6a17414da9a21bd1e6473656 in term 1.
I20260807 22:51:31.294765 31610 raft_consensus.cc:2454] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c703c4d6a17414da9a21bd1e6473656 in term 1.
I20260807 22:51:31.294939 31682 leader_election.cc:302] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c703c4d6a17414da9a21bd1e6473656, e04b9e4af01c43f3ba3471aa81bd1b1d; no voters:
I20260807 22:51:31.295123 31828 raft_consensus.cc:2781] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:31.295346 31828 raft_consensus.cc:686] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 1 LEADER]: Becoming Leader. State: Replica: 9c703c4d6a17414da9a21bd1e6473656, State: Running, Role: LEADER
I20260807 22:51:31.295666 31828 consensus_queue.cc:237] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 } } peers { permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 } } peers { permanent_uuid: "9c703c4d6a17414da9a21bd1e6473656" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 33357 } }
I20260807 22:51:31.298722 31323 catalog_manager.cc:5495] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c703c4d6a17414da9a21bd1e6473656 (127.12.112.195). New cstate: current_term: 1 leader_uuid: "9c703c4d6a17414da9a21bd1e6473656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c703c4d6a17414da9a21bd1e6473656" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 33357 } health_report { overall_health: HEALTHY } } }
W20260807 22:51:31.315649 31663 tablet.cc:2369] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:51:31.353556 31819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.349836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39514 (local address 127.12.112.195:33357)
0807 22:51:31.349983 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:31.349988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:31.350004 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:51:31.350157 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:31.350161 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:31.350225 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:31.350369 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:51:31.350628 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.351146 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.352017 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:31.352259 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:31.352370 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:31.352695 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:51:31.353101 (+ 406us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:51:31.353252 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:31.353317 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 22:51:31.353370 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:51:31.359202 31610 raft_consensus.cc:1261] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4 [term 1 FOLLOWER]: Refusing update from remote peer 9c703c4d6a17414da9a21bd1e6473656: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:31.359201 31473 raft_consensus.cc:1261] T b94e9e739fec44d0a5b1fc4ded1878b1 P e04b9e4af01c43f3ba3471aa81bd1b1d [term 1 FOLLOWER]: Refusing update from remote peer 9c703c4d6a17414da9a21bd1e6473656: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:31.359874 31828 consensus_queue.cc:1035] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dce4b43e4344d17ba9e4fea13af34a4" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:31.360085 31831 consensus_queue.cc:1035] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04b9e4af01c43f3ba3471aa81bd1b1d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:31.366925 31835 mvcc.cc:205] Tried to move back new op lower bound from 7316042102200291328 to 7316042101949558784. Current Snapshot: MvccSnapshot[applied={T|T < 7316042102200291328}]
I20260807 22:51:31.367620 31837 mvcc.cc:205] Tried to move back new op lower bound from 7316042102200291328 to 7316042101949558784. Current Snapshot: MvccSnapshot[applied={T|T < 7316042102200291328}]
I20260807 22:51:31.375469 31323 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:31.375648 31323 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:31.378086 31323 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a8b747824d94069a342f5085cf5cf1e: Sending DeleteTablet for 3 replicas of tablet b94e9e739fec44d0a5b1fc4ded1878b1
I20260807 22:51:31.378747 31452 tablet_service.cc:1514] Processing DeleteTablet for tablet b94e9e739fec44d0a5b1fc4ded1878b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:31 UTC) from {username='slave'} at 127.0.0.1:49044
I20260807 22:51:31.379279 31733 tablet_service.cc:1514] Processing DeleteTablet for tablet b94e9e739fec44d0a5b1fc4ded1878b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:31 UTC) from {username='slave'} at 127.0.0.1:39512
I20260807 22:51:31.379721 31847 tablet_replica.cc:330] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: stopping tablet replica
I20260807 22:51:31.380080 31847 raft_consensus.cc:2229] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:51:31.380457 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 31387
I20260807 22:51:31.380461 31847 raft_consensus.cc:2258] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:31.382740 31590 tablet_service.cc:1514] Processing DeleteTablet for tablet b94e9e739fec44d0a5b1fc4ded1878b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:31 UTC) from {username='slave'} at 127.0.0.1:33028
I20260807 22:51:31.384008 31847 ts_tablet_manager.cc:1905] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:31.386888 31847 ts_tablet_manager.cc:1918] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:31.387048 31847 log.cc:1196] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/b94e9e739fec44d0a5b1fc4ded1878b1
I20260807 22:51:31.387431 31847 ts_tablet_manager.cc:1939] T b94e9e739fec44d0a5b1fc4ded1878b1 P 9c703c4d6a17414da9a21bd1e6473656: Deleting consensus metadata
I20260807 22:51:31.388609 31307 catalog_manager.cc:4841] TS 9c703c4d6a17414da9a21bd1e6473656 (127.12.112.195:33357): tablet b94e9e739fec44d0a5b1fc4ded1878b1 (table test-table [id=7a45db04f7fe4932bb4200d694fb2857]) successfully deleted
I20260807 22:51:31.388751 31848 tablet_replica.cc:330] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: stopping tablet replica
I20260807 22:51:31.389043 31848 raft_consensus.cc:2229] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:51:31.389322 31848 raft_consensus.cc:2258] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:31.390844 31848 ts_tablet_manager.cc:1905] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:31.393451 31848 ts_tablet_manager.cc:1918] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:31.393603 31848 log.cc:1196] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/b94e9e739fec44d0a5b1fc4ded1878b1
I20260807 22:51:31.393975 31848 ts_tablet_manager.cc:1939] T b94e9e739fec44d0a5b1fc4ded1878b1 P 4dce4b43e4344d17ba9e4fea13af34a4: Deleting consensus metadata
I20260807 22:51:31.395471 31310 catalog_manager.cc:4841] TS 4dce4b43e4344d17ba9e4fea13af34a4 (127.12.112.194:35221): tablet b94e9e739fec44d0a5b1fc4ded1878b1 (table test-table [id=7a45db04f7fe4932bb4200d694fb2857]) successfully deleted
W20260807 22:51:31.395780 31306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:32807 (error 108)
I20260807 22:51:31.396560 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 31526
I20260807 22:51:31.397260 31817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:31.396502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:32807 (local address 127.0.0.1:49050)
0807 22:51:31.397113 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:31.397186 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":523}
W20260807 22:51:31.397477 31306 catalog_manager.cc:4584] TS e04b9e4af01c43f3ba3471aa81bd1b1d (127.12.112.193:32807): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b94e9e739fec44d0a5b1fc4ded1878b1: Network error: Client connection negotiation failed: client connection to 127.12.112.193:32807: connect: Connection refused (error 111)
I20260807 22:51:31.405126 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 31665
I20260807 22:51:31.412690 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 31290
2026-08-07T22:51:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1241 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:31 dist-test-slave-tm1g krb5kdc[31852](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:31 dist-test-slave-tm1g krb5kdc[31852](info): set up 2 sockets
Aug 07 22:51:31 dist-test-slave-tm1g krb5kdc[31852](info): commencing operation
krb5kdc: starting...
W20260807 22:51:32.473333 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:32 dist-test-slave-tm1g krb5kdc[31852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:51:32.596963 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:45089
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:34947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:45089
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:32.704604 31867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:32.704887 31867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:32.704968 31867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:32.708897 31867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:32.708984 31867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:32.709022 31867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:32.709080 31867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:32.709120 31867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:32.714140 31867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:34947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:45089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:45089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:32.715139 31867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:32.716109 31867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:32.724466 31874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:32.724438 31876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:32.724628 31867 server_base.cc:1034] running on GCE node
W20260807 22:51:32.724429 31872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:32.725281 31867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:32.726244 31867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:32.727460 31867 hybrid_clock.cc:648] HybridClock initialized: now 1786143092727433 us; error 39 us; skew 500 ppm
Aug 07 22:51:32 dist-test-slave-tm1g krb5kdc[31852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143092, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:32.730116 31867 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:51:32.730945 31867 webserver.cc:460] Webserver started at http://127.12.112.254:39293/ using document root <none> and password file <none>
I20260807 22:51:32.731444 31867 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:32.731501 31867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:32.731653 31867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:32.733546 31867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "a640b3624d854773b93cee1f601109b0"
format_stamp: "Formatted at 2026-08-07 22:51:32 on dist-test-slave-tm1g"
server_key: "91b59117946418ec9d526117739f495f"
server_key_iv: "221e68991598e75006bec16663600450"
server_key_version: "encryptionkey@0"
I20260807 22:51:32.734035 31867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "a640b3624d854773b93cee1f601109b0"
format_stamp: "Formatted at 2026-08-07 22:51:32 on dist-test-slave-tm1g"
server_key: "91b59117946418ec9d526117739f495f"
server_key_iv: "221e68991598e75006bec16663600450"
server_key_version: "encryptionkey@0"
I20260807 22:51:32.737468 31867 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:51:32.739923 31883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:32.741102 31867 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:51:32.741242 31867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "a640b3624d854773b93cee1f601109b0"
format_stamp: "Formatted at 2026-08-07 22:51:32 on dist-test-slave-tm1g"
server_key: "91b59117946418ec9d526117739f495f"
server_key_iv: "221e68991598e75006bec16663600450"
server_key_version: "encryptionkey@0"
I20260807 22:51:32.741353 31867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:32.761096 31867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:32.764147 31867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:32.764350 31867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:32.771548 31867 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:45089
I20260807 22:51:32.771566 31936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:45089 every 8 connection(s)
I20260807 22:51:32.772451 31867 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:32.775105 31937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:32.780390 31937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0: Bootstrap starting.
I20260807 22:51:32.782702 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 31867
I20260807 22:51:32.782756 31937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:32.782855 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:32.783130 12739 external_mini_cluster.cc:1428] Setting key bb9fbb3dbe4e32c6b7784b3d59b56375
I20260807 22:51:32.783531 31937 log.cc:824] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:32.785451 31937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0: No bootstrap required, opened a new log
I20260807 22:51:32.788836 31937 raft_consensus.cc:348] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a640b3624d854773b93cee1f601109b0" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45089 } }
I20260807 22:51:32.789044 31937 raft_consensus.cc:374] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:32.789105 31937 raft_consensus.cc:729] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a640b3624d854773b93cee1f601109b0, State: Initialized, Role: FOLLOWER
I20260807 22:51:32.789562 31937 consensus_queue.cc:260] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a640b3624d854773b93cee1f601109b0" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45089 } }
I20260807 22:51:32.789747 31937 raft_consensus.cc:388] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:32.789821 31937 raft_consensus.cc:482] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:32.789948 31937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:32.790859 31937 raft_consensus.cc:504] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a640b3624d854773b93cee1f601109b0" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45089 } }
I20260807 22:51:32.791266 31937 leader_election.cc:302] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a640b3624d854773b93cee1f601109b0; no voters:
I20260807 22:51:32.791625 31937 leader_election.cc:288] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [CANDIDATE]: Term 1 election: Requested vote from peers
Aug 07 22:51:32 dist-test-slave-tm1g krb5kdc[31852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:32.791725 31943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:32.791986 31943 raft_consensus.cc:686] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [term 1 LEADER]: Becoming Leader. State: Replica: a640b3624d854773b93cee1f601109b0, State: Running, Role: LEADER
I20260807 22:51:32.792366 31943 consensus_queue.cc:237] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a640b3624d854773b93cee1f601109b0" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45089 } }
I20260807 22:51:32.792918 31937 sys_catalog.cc:564] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:32.795758 31945 sys_catalog.cc:455] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a640b3624d854773b93cee1f601109b0. Latest consensus state: current_term: 1 leader_uuid: "a640b3624d854773b93cee1f601109b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a640b3624d854773b93cee1f601109b0" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45089 } } }
I20260807 22:51:32.795854 31945 sys_catalog.cc:458] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:32.795575 31944 sys_catalog.cc:455] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a640b3624d854773b93cee1f601109b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a640b3624d854773b93cee1f601109b0" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45089 } } }
I20260807 22:51:32.796020 31944 sys_catalog.cc:458] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0 [sys.catalog]: This master's current role is: LEADER
W20260807 22:51:32.797951 31958 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:51:32.798039 31958 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:51:32.798147 31959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:32.798822 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:32.784225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46770 (local address 127.12.112.254:45089)
0807 22:51:32.784653 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:32.784673 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:32.784717 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:51:32.785342 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:32.785358 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:32.785711 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:32.786030 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:32.786886 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:32.787834 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:32.788694 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:32.789264 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:32.789443 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:32.792354 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:32.792359 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:32.792374 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:32.792412 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:32.794588 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:32.795830 (+ 1242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:32.795838 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:32.795844 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:32.796016 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:32.796366 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:32.796374 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:32.796376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:32.796852 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:32.797086 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:32.797368 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 22:51:32.797820 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":143,"threads_started":1}
I20260807 22:51:32.798887 31959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:32.803952 31959 catalog_manager.cc:1347] Generated new cluster ID: 686988d024b144e9a44af9e3b80912ba
I20260807 22:51:32.804011 31959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:32.823164 31959 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:32.824162 31959 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:32.830179 31959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0: Generated new TSK 0
I20260807 22:51:32.830883 31959 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:51:32.859400 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45089
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:34947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:32.970155 31964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:32.970470 31964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:32.970517 31964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:32.974335 31964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:32.974378 31964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:32.974431 31964 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:51:32.979461 31964 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:34947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:32.980345 31964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:32.981246 31964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:51:32.990536 31964 server_base.cc:1034] running on GCE node
W20260807 22:51:32.990514 31972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:32.990780 31969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:32.990507 31970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:32.991195 31964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:32.991801 31964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:32.992983 31964 hybrid_clock.cc:648] HybridClock initialized: now 1786143092992969 us; error 28 us; skew 500 ppm
Aug 07 22:51:32 dist-test-slave-tm1g krb5kdc[31852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143092, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:32.995882 31964 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:51:32.996673 31964 webserver.cc:460] Webserver started at http://127.12.112.193:34387/ using document root <none> and password file <none>
I20260807 22:51:32.997201 31964 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:32.997290 31964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:32.997521 31964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:32.999509 31964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "3ff1263851ae43358a4859dc07328984"
format_stamp: "Formatted at 2026-08-07 22:51:32 on dist-test-slave-tm1g"
server_key: "f7d97df732b5f286840d9c60d9816b96"
server_key_iv: "9c282c86ad883464ca113718e14673fc"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.000056 31964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "3ff1263851ae43358a4859dc07328984"
format_stamp: "Formatted at 2026-08-07 22:51:32 on dist-test-slave-tm1g"
server_key: "f7d97df732b5f286840d9c60d9816b96"
server_key_iv: "9c282c86ad883464ca113718e14673fc"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.003548 31964 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:51:33.005843 31980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:33.007063 31964 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:33.007201 31964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "3ff1263851ae43358a4859dc07328984"
format_stamp: "Formatted at 2026-08-07 22:51:32 on dist-test-slave-tm1g"
server_key: "f7d97df732b5f286840d9c60d9816b96"
server_key_iv: "9c282c86ad883464ca113718e14673fc"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.007311 31964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:33.031874 31964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:33.034855 31964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:33.035069 31964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:33.035655 31964 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:33.036458 31964 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:33.036528 31964 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:33.036600 31964 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:33.036636 31964 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:33.045905 31964 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:39673
I20260807 22:51:33.045935 32102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:39673 every 8 connection(s)
I20260807 22:51:33.046797 31964 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
Aug 07 22:51:33 dist-test-slave-tm1g krb5kdc[31852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143092, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:33.055735 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 31964
I20260807 22:51:33.055944 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:51:33.056236 12739 external_mini_cluster.cc:1428] Setting key ddf357dd189fd8acae27b64af3ab41bc
I20260807 22:51:33.060251 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.048520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:52175 (local address 127.12.112.254:45089)
0807 22:51:33.048671 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.048676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.049509 (+ 833us) server_negotiation.cc:407] Connection header received
0807 22:51:33.050775 (+ 1266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.050777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.050824 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.050896 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:33.051965 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.052502 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.053581 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.053803 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.053879 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.056373 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:33.056377 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:33.056380 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:33.056410 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:33.058155 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:33.058696 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:33.058703 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:33.058708 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:33.058805 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:33.059128 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:33.059134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:33.059139 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:33.059406 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:33.059509 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.059952 (+ 443us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.060080 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:51:33.061024 32105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.048926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:45089 (local address 127.12.112.193:52175)
0807 22:51:33.049359 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.049399 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:33.050588 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:33.051046 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:33.051052 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:33.051392 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:33.051837 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.051849 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.052606 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.052608 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.053477 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.053485 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.053958 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.053960 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.054093 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.054669 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:33.054685 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:33.056184 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:33.058283 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:33.058287 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:33.058297 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:33.058589 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:33.058898 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:33.058900 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:33.058902 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:33.059030 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:33.059505 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:33.059509 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:33.059709 (+ 200us) client_negotiation.cc:769] Sending connection context
0807 22:51:33.059883 (+ 174us) client_negotiation.cc:240] Negotiation successful
0807 22:51:33.060197 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":115,"threads_started":1}
I20260807 22:51:33.062292 32103 heartbeater.cc:347] Connected to a master server at 127.12.112.254:45089
I20260807 22:51:33.062572 32103 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:33.063023 32103 heartbeater.cc:511] Master 127.12.112.254:45089 requested a full tablet report, sending...
I20260807 22:51:33.064433 31900 ts_manager.cc:194] Registered new tserver with Master: 3ff1263851ae43358a4859dc07328984 (127.12.112.193:39673)
I20260807 22:51:33.065531 31900 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:52175
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:51:33.083323 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45089
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:34947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:33.194031 32108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:33.194342 32108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:33.194398 32108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:33.198257 32108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:33.198351 32108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:33.198421 32108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:51:33.203488 32108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:34947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:33.204355 32108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:33.205240 32108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:33.214386 32113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:33.214452 32116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:33.214440 32108 server_base.cc:1034] running on GCE node
W20260807 22:51:33.214392 32114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:33.215018 32108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:33.215612 32108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:33.216796 32108 hybrid_clock.cc:648] HybridClock initialized: now 1786143093216772 us; error 37 us; skew 500 ppm
Aug 07 22:51:33 dist-test-slave-tm1g krb5kdc[31852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:33.219578 32108 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:51:33.220391 32108 webserver.cc:460] Webserver started at http://127.12.112.194:40715/ using document root <none> and password file <none>
I20260807 22:51:33.220912 32108 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:33.220999 32108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:33.221220 32108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:33.223177 32108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "392a7eeb564a4957b943d084664f2bfb"
format_stamp: "Formatted at 2026-08-07 22:51:33 on dist-test-slave-tm1g"
server_key: "6d466d641cffe399623ccdcdf8b551e4"
server_key_iv: "f5228c94cd51388bc833d2758ad82129"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.223734 32108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "392a7eeb564a4957b943d084664f2bfb"
format_stamp: "Formatted at 2026-08-07 22:51:33 on dist-test-slave-tm1g"
server_key: "6d466d641cffe399623ccdcdf8b551e4"
server_key_iv: "f5228c94cd51388bc833d2758ad82129"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.227160 32108 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:51:33.229405 32123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:33.230613 32108 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:33.230741 32108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "392a7eeb564a4957b943d084664f2bfb"
format_stamp: "Formatted at 2026-08-07 22:51:33 on dist-test-slave-tm1g"
server_key: "6d466d641cffe399623ccdcdf8b551e4"
server_key_iv: "f5228c94cd51388bc833d2758ad82129"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.230847 32108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:33.250447 32108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:33.253558 32108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:33.253746 32108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:33.254293 32108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:33.255121 32108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:33.255191 32108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:33.255261 32108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:33.255303 32108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:33.263783 32108 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:33211
I20260807 22:51:33.263808 32243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:33211 every 8 connection(s)
I20260807 22:51:33.264626 32108 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:51:33.269670 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 32108
I20260807 22:51:33.269811 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:51:33.270193 12739 external_mini_cluster.cc:1428] Setting key 476c474e36d5c9b34816e7e7d29f7bce
Aug 07 22:51:33 dist-test-slave-tm1g krb5kdc[31852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:33.279927 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.266405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:33807 (local address 127.12.112.254:45089)
0807 22:51:33.266566 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.266570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.267314 (+ 744us) server_negotiation.cc:407] Connection header received
0807 22:51:33.268875 (+ 1561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.268878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.268953 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.269072 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:33.270612 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.271298 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.272847 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.273083 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.273166 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.276159 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:33.276163 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:33.276165 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:33.276187 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:33.277644 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:33.278362 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:33.278370 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:33.278371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:33.278448 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:33.278860 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:33.278862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:33.278864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:33.279034 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:33.279106 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.279707 (+ 601us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.279806 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 22:51:33.281108 32246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.266748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:45089 (local address 127.12.112.194:33807)
0807 22:51:33.267166 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.267205 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:33.268663 (+ 1458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:33.269253 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:33.269261 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:33.269749 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:33.270458 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.270475 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.271432 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.271435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.272720 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.272734 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.273236 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.273242 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.273485 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.274082 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:33.274108 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:33.275999 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:33.277766 (+ 1767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:33.277776 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:33.277793 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:33.278187 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:33.278546 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:33.278553 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:33.278558 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:33.278752 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:33.279139 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:33.279147 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:33.279458 (+ 311us) client_negotiation.cc:769] Sending connection context
0807 22:51:33.279663 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 22:51:33.280023 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:51:33.282258 32244 heartbeater.cc:347] Connected to a master server at 127.12.112.254:45089
I20260807 22:51:33.282511 32244 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:33.283074 32244 heartbeater.cc:511] Master 127.12.112.254:45089 requested a full tablet report, sending...
I20260807 22:51:33.284157 31900 ts_manager.cc:194] Registered new tserver with Master: 392a7eeb564a4957b943d084664f2bfb (127.12.112.194:33211)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
I20260807 22:51:33.284801 31900 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:33807
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:51:33.299419 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45089
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:34947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:33.407793 32249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:33.408053 32249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:33.408128 32249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:33.412148 32249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:33.412220 32249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:33.412304 32249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:51:33.417373 32249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:34947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:45089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:33.418416 32249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:33.419363 32249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:51:33.429060 32249 server_base.cc:1034] running on GCE node
W20260807 22:51:33.428994 32255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:33.428990 32254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:33.429023 32257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:33.429656 32249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:33.430253 32249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:33.431485 32249 hybrid_clock.cc:648] HybridClock initialized: now 1786143093431470 us; error 27 us; skew 500 ppm
Aug 07 22:51:33 dist-test-slave-tm1g krb5kdc[31852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:33.434122 32249 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:51:33.435079 32249 webserver.cc:460] Webserver started at http://127.12.112.195:43509/ using document root <none> and password file <none>
I20260807 22:51:33.435618 32249 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:33.435711 32249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:33.435945 32249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:33.437912 32249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "7157ba1989834dd2998b0982bd18ef20"
format_stamp: "Formatted at 2026-08-07 22:51:33 on dist-test-slave-tm1g"
server_key: "7204229100224919c3472672981ee0fe"
server_key_iv: "6c088c25e7f41cb03b147b03cfab4eaf"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.438529 32249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "7157ba1989834dd2998b0982bd18ef20"
format_stamp: "Formatted at 2026-08-07 22:51:33 on dist-test-slave-tm1g"
server_key: "7204229100224919c3472672981ee0fe"
server_key_iv: "6c088c25e7f41cb03b147b03cfab4eaf"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.442029 32249 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:51:33.444473 32264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:33.445695 32249 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:33.445811 32249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "7157ba1989834dd2998b0982bd18ef20"
format_stamp: "Formatted at 2026-08-07 22:51:33 on dist-test-slave-tm1g"
server_key: "7204229100224919c3472672981ee0fe"
server_key_iv: "6c088c25e7f41cb03b147b03cfab4eaf"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.445919 32249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:33.457695 32249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:33.460386 32249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:33.460578 32249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:33.461150 32249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:33.461918 32249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:33.461966 32249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:33.462033 32249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:33.462070 32249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:33.470947 32249 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:42105
I20260807 22:51:33.470983 32383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:42105 every 8 connection(s)
I20260807 22:51:33.471761 32249 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:51:33.475100 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 32249
I20260807 22:51:33.475253 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:51:33.475555 12739 external_mini_cluster.cc:1428] Setting key 582e08bb2a086333e96d0c58b234cad4
Aug 07 22:51:33 dist-test-slave-tm1g krb5kdc[31852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:33.485235 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.473398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:48315 (local address 127.12.112.254:45089)
0807 22:51:33.473579 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.473584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.474336 (+ 752us) server_negotiation.cc:407] Connection header received
0807 22:51:33.475792 (+ 1456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.475795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.475859 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.475953 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:33.477197 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.477895 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.479094 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.479312 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.479395 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.481743 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:33.481746 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:33.481748 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:33.481772 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:33.483250 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:33.483750 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:33.483754 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:33.483756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:33.483848 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:33.484188 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:33.484192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:33.484193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:33.484381 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:33.484487 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.484954 (+ 467us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.485070 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 22:51:33.485978 32386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.473760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:45089 (local address 127.12.112.195:48315)
0807 22:51:33.474172 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.474212 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:33.475562 (+ 1350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:33.476148 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:33.476154 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:33.476536 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:33.477068 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.477080 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.478007 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.478009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.478984 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.478994 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.479446 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.479449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.479578 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.480121 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:33.480137 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:33.481577 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:33.483374 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:33.483380 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:33.483393 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:33.483643 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:33.483950 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:33.483953 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:33.483954 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:33.484092 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:33.484486 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:33.484492 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:33.484718 (+ 226us) client_negotiation.cc:769] Sending connection context
0807 22:51:33.484894 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 22:51:33.485187 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":105,"threads_started":1}
I20260807 22:51:33.487082 32384 heartbeater.cc:347] Connected to a master server at 127.12.112.254:45089
I20260807 22:51:33.487325 32384 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:33.487774 32384 heartbeater.cc:511] Master 127.12.112.254:45089 requested a full tablet report, sending...
I20260807 22:51:33.488832 31900 ts_manager.cc:194] Registered new tserver with Master: 7157ba1989834dd2998b0982bd18ef20 (127.12.112.195:42105)
I20260807 22:51:33.489439 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:51:33.489580 31900 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:48315
I20260807 22:51:33.498739 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.491575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46784 (local address 127.12.112.254:45089)
0807 22:51:33.491718 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.491722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.491898 (+ 176us) server_negotiation.cc:407] Connection header received
0807 22:51:33.491999 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.492001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.492035 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.492094 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:33.492749 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.493224 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.494125 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.494416 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.494491 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.495837 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:33.495839 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:33.495841 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:33.495862 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:33.497198 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:33.497622 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:33.497624 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:33.497626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:33.497693 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:33.497949 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:33.497951 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:33.497952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:33.498120 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:33.498229 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.498481 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.498552 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 22:51:33.501336 31900 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:51:33.504343 31900 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:51:33.518010 32397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.512037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:33211 (local address 127.0.0.1:46316)
0807 22:51:33.512509 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.512556 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:33.512688 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:33.513732 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:33.513735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:33.513750 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:33.513833 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.513838 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.515259 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.515268 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.516566 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.516599 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.517498 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.517501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.517611 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.517653 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 22:51:33.517752 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 22:51:33.517862 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":109,"thread_start_us":80,"threads_started":1}
I20260807 22:51:33.518224 32398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.512152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46316 (local address 127.12.112.194:33211)
0807 22:51:33.513103 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.513113 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.513133 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:51:33.513205 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.513210 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.513399 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.513553 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:33.513970 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.515116 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.516730 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.517374 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.517502 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.517640 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.517964 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.518077 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":847,"thread_start_us":121,"threads_started":1}
I20260807 22:51:33.518179 32396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.512177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:42105 (local address 127.0.0.1:35556)
0807 22:51:33.512733 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.512748 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:33.512833 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:33.513372 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:33.513379 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:33.513400 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:33.513552 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.513560 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.515186 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.515189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.516626 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.516636 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.517744 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.517748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.517840 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.517864 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:51:33.517936 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 22:51:33.518005 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":26,"thread_start_us":85,"threads_started":1}
I20260807 22:51:33.518819 32399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.512517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35556 (local address 127.12.112.195:42105)
0807 22:51:33.512841 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.512878 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.512905 (+ 27us) server_negotiation.cc:407] Connection header received
0807 22:51:33.512982 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.512989 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.513183 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.513697 (+ 514us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:33.513835 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.515042 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.516760 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.517627 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.517755 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.517866 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.518278 (+ 412us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.518671 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":108,"threads_started":1}
I20260807 22:51:33.519008 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.513594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37210 (local address 127.12.112.193:39673)
0807 22:51:33.513881 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.513897 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.514123 (+ 226us) server_negotiation.cc:407] Connection header received
0807 22:51:33.514257 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.514261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.514512 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.514685 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:33.514867 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.515932 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.517338 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.518173 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.518294 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.518449 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.518778 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.518876 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":122,"threads_started":1}
I20260807 22:51:33.519200 32400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.513196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:39673 (local address 127.0.0.1:37210)
0807 22:51:33.514025 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.514036 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:33.514143 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:33.514659 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:33.514662 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:33.514680 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:33.514771 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.514779 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.516082 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.516086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.517205 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.517215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.518514 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.518520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.518629 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.518651 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:51:33.518730 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 22:51:33.518806 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":782,"mutex_wait_us":24,"thread_start_us":92,"threads_started":1}
I20260807 22:51:33.521353 32175 tablet_service.cc:1467] Processing CreateTablet for tablet 8f25fa43e85d4bdf972bc50feca1c7c1 (DEFAULT_TABLE table=test-table [id=3d23e27d8b1b4b919e3acc30fa0a2863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:33.521343 32316 tablet_service.cc:1467] Processing CreateTablet for tablet 8f25fa43e85d4bdf972bc50feca1c7c1 (DEFAULT_TABLE table=test-table [id=3d23e27d8b1b4b919e3acc30fa0a2863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:33.522404 32316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f25fa43e85d4bdf972bc50feca1c7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:33.522410 32175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f25fa43e85d4bdf972bc50feca1c7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:33.522179 32034 tablet_service.cc:1467] Processing CreateTablet for tablet 8f25fa43e85d4bdf972bc50feca1c7c1 (DEFAULT_TABLE table=test-table [id=3d23e27d8b1b4b919e3acc30fa0a2863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:33.523092 32034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f25fa43e85d4bdf972bc50feca1c7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:33.529887 32404 tablet_bootstrap.cc:492] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984: Bootstrap starting.
I20260807 22:51:33.529953 32402 tablet_bootstrap.cc:492] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: Bootstrap starting.
I20260807 22:51:33.530058 32403 tablet_bootstrap.cc:492] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: Bootstrap starting.
I20260807 22:51:33.531811 32402 tablet_bootstrap.cc:654] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:33.532071 32403 tablet_bootstrap.cc:654] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:33.532071 32404 tablet_bootstrap.cc:654] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:33.532966 32402 log.cc:824] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:33.533397 32403 log.cc:824] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:33.533397 32404 log.cc:824] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:33.535347 32404 tablet_bootstrap.cc:492] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984: No bootstrap required, opened a new log
I20260807 22:51:33.535423 32402 tablet_bootstrap.cc:492] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: No bootstrap required, opened a new log
I20260807 22:51:33.535423 32403 tablet_bootstrap.cc:492] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: No bootstrap required, opened a new log
I20260807 22:51:33.535565 32404 ts_tablet_manager.cc:1397] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:51:33.535601 32402 ts_tablet_manager.cc:1397] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 22:51:33.535601 32403 ts_tablet_manager.cc:1397] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260807 22:51:33.538275 32404 raft_consensus.cc:348] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } }
I20260807 22:51:33.538579 32404 raft_consensus.cc:374] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:33.538655 32404 raft_consensus.cc:729] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff1263851ae43358a4859dc07328984, State: Initialized, Role: FOLLOWER
I20260807 22:51:33.539103 32404 consensus_queue.cc:260] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } }
I20260807 22:51:33.539346 32403 raft_consensus.cc:348] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } }
I20260807 22:51:33.539346 32402 raft_consensus.cc:348] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } }
I20260807 22:51:33.539585 32402 raft_consensus.cc:374] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:33.539649 32403 raft_consensus.cc:374] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:33.539680 32402 raft_consensus.cc:729] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7157ba1989834dd2998b0982bd18ef20, State: Initialized, Role: FOLLOWER
I20260807 22:51:33.539740 32103 heartbeater.cc:503] Master 127.12.112.254:45089 was elected leader, sending a full tablet report...
I20260807 22:51:33.539752 32403 raft_consensus.cc:729] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 392a7eeb564a4957b943d084664f2bfb, State: Initialized, Role: FOLLOWER
I20260807 22:51:33.540086 32404 ts_tablet_manager.cc:1428] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260807 22:51:33.540172 32402 consensus_queue.cc:260] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } }
I20260807 22:51:33.540172 32403 consensus_queue.cc:260] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } }
I20260807 22:51:33.541045 32403 ts_tablet_manager.cc:1428] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260807 22:51:33.541045 32402 ts_tablet_manager.cc:1428] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 22:51:33.541379 32244 heartbeater.cc:503] Master 127.12.112.254:45089 was elected leader, sending a full tablet report...
I20260807 22:51:33.541553 32384 heartbeater.cc:503] Master 127.12.112.254:45089 was elected leader, sending a full tablet report...
W20260807 22:51:33.547848 32104 tablet.cc:2369] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:51:33.681665 32410 raft_consensus.cc:482] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:33.681900 32410 raft_consensus.cc:504] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } }
I20260807 22:51:33.683118 32410 leader_election.cc:288] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7157ba1989834dd2998b0982bd18ef20 (127.12.112.195:42105), 3ff1263851ae43358a4859dc07328984 (127.12.112.193:39673)
I20260807 22:51:33.685806 32409 raft_consensus.cc:482] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:33.685986 32409 raft_consensus.cc:504] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } }
I20260807 22:51:33.687081 32409 leader_election.cc:288] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 392a7eeb564a4957b943d084664f2bfb (127.12.112.194:33211), 3ff1263851ae43358a4859dc07328984 (127.12.112.193:39673)
I20260807 22:51:33.688520 32246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.683362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:39673 (local address 127.12.112.194:32855)
0807 22:51:33.683556 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.683571 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:33.683667 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:33.683986 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:33.683988 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:33.684002 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:33.684145 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.684152 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.685214 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.685217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.686777 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.686789 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.688030 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.688033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.688194 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.688218 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:51:33.688294 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:51:33.688370 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":212}
I20260807 22:51:33.688542 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.683513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:32855 (local address 127.12.112.193:39673)
0807 22:51:33.683641 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.683645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.683664 (+ 19us) server_negotiation.cc:407] Connection header received
0807 22:51:33.683786 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.683789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.683863 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.683954 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:33.684264 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.685097 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.687138 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.687740 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.687870 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.687929 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.688312 (+ 383us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.688413 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:51:33.689158 32399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.683453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:54251 (local address 127.12.112.195:42105)
0807 22:51:33.683586 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.683593 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.683873 (+ 280us) server_negotiation.cc:407] Connection header received
0807 22:51:33.683944 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.683947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.683999 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.684079 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:33.684343 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.685097 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.686909 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.688418 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.688520 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.688575 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.688960 (+ 385us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.689026 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:51:33.689100 32055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f25fa43e85d4bdf972bc50feca1c7c1" candidate_uuid: "392a7eeb564a4957b943d084664f2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff1263851ae43358a4859dc07328984" is_pre_election: true
I20260807 22:51:33.689383 32055 raft_consensus.cc:2454] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 392a7eeb564a4957b943d084664f2bfb in term 0.
I20260807 22:51:33.689693 32411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.683360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:42105 (local address 127.12.112.194:54251)
0807 22:51:33.683762 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.683776 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:33.683863 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:33.684094 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:33.684098 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:33.684116 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:33.684226 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.684231 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.685214 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.685217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.686777 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.686789 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.688717 (+ 1928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.688722 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.688826 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.688848 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:51:33.689440 (+ 592us) client_negotiation.cc:240] Negotiation successful
0807 22:51:33.689551 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":102,"thread_start_us":143,"threads_started":1}
I20260807 22:51:33.690083 32125 leader_election.cc:302] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 392a7eeb564a4957b943d084664f2bfb, 3ff1263851ae43358a4859dc07328984; no voters:
I20260807 22:51:33.690377 32410 raft_consensus.cc:2781] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:51:33.690480 32410 raft_consensus.cc:482] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:51:33.690555 32410 raft_consensus.cc:3037] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:33.690703 32337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f25fa43e85d4bdf972bc50feca1c7c1" candidate_uuid: "392a7eeb564a4957b943d084664f2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7157ba1989834dd2998b0982bd18ef20" is_pre_election: true
I20260807 22:51:33.690896 32337 raft_consensus.cc:2454] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 392a7eeb564a4957b943d084664f2bfb in term 0.
I20260807 22:51:33.691926 32386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.687248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:39673 (local address 127.12.112.195:34025)
0807 22:51:33.687348 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.687362 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:33.687435 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:33.688176 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:33.688180 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:33.688199 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:33.688308 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.688315 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.689433 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.689437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.690648 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.690657 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.691566 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.691570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.691665 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.691687 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:51:33.691736 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 22:51:33.691798 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":3}
I20260807 22:51:33.691891 32410 raft_consensus.cc:504] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } }
I20260807 22:51:33.692298 32410 leader_election.cc:288] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [CANDIDATE]: Term 1 election: Requested vote from peers 7157ba1989834dd2998b0982bd18ef20 (127.12.112.195:42105), 3ff1263851ae43358a4859dc07328984 (127.12.112.193:39673)
I20260807 22:51:33.692394 32413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.687634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:34025 (local address 127.12.112.193:39673)
0807 22:51:33.687931 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.687953 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.687968 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:51:33.688004 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.688007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.688048 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.688413 (+ 365us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:33.688491 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.689295 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.690792 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.691432 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.692106 (+ 674us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.692149 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.692185 (+ 36us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.692260 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":103,"threads_started":1}
I20260807 22:51:33.692667 32337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f25fa43e85d4bdf972bc50feca1c7c1" candidate_uuid: "392a7eeb564a4957b943d084664f2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7157ba1989834dd2998b0982bd18ef20"
I20260807 22:51:33.692806 32337 raft_consensus.cc:3037] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:33.692962 32412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.687248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:33211 (local address 127.12.112.195:49279)
0807 22:51:33.687741 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.687755 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:33.687893 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:33.688928 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:33.688934 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:33.688958 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:33.689057 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.689063 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.690011 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.690014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.691455 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:33.691466 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.692475 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.692478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:33.692621 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.692649 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 22:51:33.692733 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 22:51:33.692805 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"mutex_wait_us":404,"thread_start_us":112,"threads_started":1}
I20260807 22:51:33.692966 32398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.687379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:49279 (local address 127.12.112.194:33211)
0807 22:51:33.687494 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.687501 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.687830 (+ 329us) server_negotiation.cc:407] Connection header received
0807 22:51:33.688008 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.688010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.688052 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.688130 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:33.689181 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.689872 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.691608 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.692167 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.692270 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.692311 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.692765 (+ 454us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.692847 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:51:33.692914 32054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f25fa43e85d4bdf972bc50feca1c7c1" candidate_uuid: "7157ba1989834dd2998b0982bd18ef20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff1263851ae43358a4859dc07328984" is_pre_election: true
I20260807 22:51:33.693045 32054 raft_consensus.cc:2454] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7157ba1989834dd2998b0982bd18ef20 in term 0.
I20260807 22:51:33.693467 32266 leader_election.cc:302] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff1263851ae43358a4859dc07328984, 7157ba1989834dd2998b0982bd18ef20; no voters:
I20260807 22:51:33.693506 32055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f25fa43e85d4bdf972bc50feca1c7c1" candidate_uuid: "392a7eeb564a4957b943d084664f2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff1263851ae43358a4859dc07328984"
I20260807 22:51:33.693610 32055 raft_consensus.cc:3037] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:33.694056 32195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f25fa43e85d4bdf972bc50feca1c7c1" candidate_uuid: "7157ba1989834dd2998b0982bd18ef20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "392a7eeb564a4957b943d084664f2bfb" is_pre_election: true
I20260807 22:51:33.694149 32337 raft_consensus.cc:2454] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 392a7eeb564a4957b943d084664f2bfb in term 1.
I20260807 22:51:33.694335 32195 raft_consensus.cc:2379] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7157ba1989834dd2998b0982bd18ef20 in current term 1: Already voted for candidate 392a7eeb564a4957b943d084664f2bfb in this term.
I20260807 22:51:33.694350 32409 raft_consensus.cc:2741] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 22:51:33.694813 32127 leader_election.cc:302] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 392a7eeb564a4957b943d084664f2bfb, 7157ba1989834dd2998b0982bd18ef20; no voters:
I20260807 22:51:33.695029 32410 raft_consensus.cc:2781] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:33.695019 32055 raft_consensus.cc:2454] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 392a7eeb564a4957b943d084664f2bfb in term 1.
I20260807 22:51:33.695240 32410 raft_consensus.cc:686] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 1 LEADER]: Becoming Leader. State: Replica: 392a7eeb564a4957b943d084664f2bfb, State: Running, Role: LEADER
I20260807 22:51:33.695564 32410 consensus_queue.cc:237] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } }
I20260807 22:51:33.698693 31899 catalog_manager.cc:5495] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 392a7eeb564a4957b943d084664f2bfb (127.12.112.194). New cstate: current_term: 1 leader_uuid: "392a7eeb564a4957b943d084664f2bfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392a7eeb564a4957b943d084664f2bfb" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 33211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 } health_report { overall_health: UNKNOWN } } }
W20260807 22:51:33.722709 32385 tablet.cc:2369] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:51:33.752339 32398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.748822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46318 (local address 127.12.112.194:33211)
0807 22:51:33.748956 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:33.748961 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:33.748976 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:51:33.749129 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:33.749132 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:33.749199 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:33.749318 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:51:33.749607 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.750124 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.751043 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:33.751252 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:33.751329 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:33.751618 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:51:33.752015 (+ 397us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:51:33.752125 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:33.752202 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 22:51:33.752233 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 22:51:33.758273 32337 raft_consensus.cc:1261] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 1 FOLLOWER]: Refusing update from remote peer 392a7eeb564a4957b943d084664f2bfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:33.758273 32055 raft_consensus.cc:1261] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 3ff1263851ae43358a4859dc07328984 [term 1 FOLLOWER]: Refusing update from remote peer 392a7eeb564a4957b943d084664f2bfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:33.758978 32410 consensus_queue.cc:1035] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff1263851ae43358a4859dc07328984" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:33.759200 32414 consensus_queue.cc:1035] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7157ba1989834dd2998b0982bd18ef20" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:33.766315 32417 mvcc.cc:205] Tried to move back new op lower bound from 7316042112026341376 to 7316042111779270656. Current Snapshot: MvccSnapshot[applied={T|T < 7316042112026341376}]
I20260807 22:51:33.768348 32418 mvcc.cc:205] Tried to move back new op lower bound from 7316042112026341376 to 7316042111779270656. Current Snapshot: MvccSnapshot[applied={T|T < 7316042112026341376}]
I20260807 22:51:33.768641 32419 mvcc.cc:205] Tried to move back new op lower bound from 7316042112026341376 to 7316042111779270656. Current Snapshot: MvccSnapshot[applied={T|T < 7316042112026341376}]
I20260807 22:51:33.775111 31899 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:33.775282 31899 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:33.777793 31899 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a640b3624d854773b93cee1f601109b0: Sending DeleteTablet for 3 replicas of tablet 8f25fa43e85d4bdf972bc50feca1c7c1
I20260807 22:51:33.778574 32175 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f25fa43e85d4bdf972bc50feca1c7c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:33 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:46316
I20260807 22:51:33.779116 32034 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f25fa43e85d4bdf972bc50feca1c7c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:33 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:37210
I20260807 22:51:33.779247 32316 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f25fa43e85d4bdf972bc50feca1c7c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:33 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:35556
I20260807 22:51:33.780221 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 31964
I20260807 22:51:33.785096 32426 tablet_replica.cc:330] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: stopping tablet replica
I20260807 22:51:33.785411 32428 tablet_replica.cc:330] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: stopping tablet replica
I20260807 22:51:33.785439 32426 raft_consensus.cc:2229] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:51:33.785786 32428 raft_consensus.cc:2229] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:51:33.785825 32426 raft_consensus.cc:2258] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:33.786280 32428 raft_consensus.cc:2258] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:33.787480 32426 ts_tablet_manager.cc:1905] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:33.787726 32428 ts_tablet_manager.cc:1905] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:33.789817 32428 ts_tablet_manager.cc:1918] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:33.789934 32428 log.cc:1196] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/8f25fa43e85d4bdf972bc50feca1c7c1
I20260807 22:51:33.790217 32426 ts_tablet_manager.cc:1918] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:33.790256 32428 ts_tablet_manager.cc:1939] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 7157ba1989834dd2998b0982bd18ef20: Deleting consensus metadata
I20260807 22:51:33.790330 32426 log.cc:1196] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/8f25fa43e85d4bdf972bc50feca1c7c1
I20260807 22:51:33.790627 32426 ts_tablet_manager.cc:1939] T 8f25fa43e85d4bdf972bc50feca1c7c1 P 392a7eeb564a4957b943d084664f2bfb: Deleting consensus metadata
I20260807 22:51:33.791440 31887 catalog_manager.cc:4841] TS 7157ba1989834dd2998b0982bd18ef20 (127.12.112.195:42105): tablet 8f25fa43e85d4bdf972bc50feca1c7c1 (table test-table [id=3d23e27d8b1b4b919e3acc30fa0a2863]) successfully deleted
I20260807 22:51:33.791610 31886 catalog_manager.cc:4841] TS 392a7eeb564a4957b943d084664f2bfb (127.12.112.194:33211): tablet 8f25fa43e85d4bdf972bc50feca1c7c1 (table test-table [id=3d23e27d8b1b4b919e3acc30fa0a2863]) successfully deleted
W20260807 22:51:33.795699 31885 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:39673 (error 108)
I20260807 22:51:33.795811 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 32108
I20260807 22:51:33.797547 32400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:33.797249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:39673 (local address 127.0.0.1:37218)
0807 22:51:33.797396 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:33.797477 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:39673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 22:51:33.798018 31885 catalog_manager.cc:4584] TS 3ff1263851ae43358a4859dc07328984 (127.12.112.193:39673): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f25fa43e85d4bdf972bc50feca1c7c1: Network error: Client connection negotiation failed: client connection to 127.12.112.193:39673: connect: Connection refused (error 111)
I20260807 22:51:33.802234 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 32249
I20260807 22:51:33.809358 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 31867
2026-08-07T22:51:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2398 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T22:51:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:33Z Disabled control of system clock
I20260807 22:51:33.841744 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:43585
--webserver_interface=127.12.112.254
--webserver_port=0
--builtin_ntp_servers=127.12.112.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:43585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:51:33.949591 32433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:33.949831 32433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:33.949867 32433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:33.953724 32433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:33.953769 32433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:33.953784 32433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:33.953800 32433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:33.953815 32433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:33.958626 32433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:43585
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:43585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:33.959581 32433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:33.960861 32433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:51:33.969273 32433 server_base.cc:1034] running on GCE node
W20260807 22:51:33.969198 32441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:33.969195 32443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:33.969206 32439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:33.969988 32433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:33.971060 32433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:33.972241 32433 hybrid_clock.cc:648] HybridClock initialized: now 1786143093972208 us; error 47 us; skew 500 ppm
I20260807 22:51:33.973979 32433 webserver.cc:460] Webserver started at http://127.12.112.254:34839/ using document root <none> and password file <none>
I20260807 22:51:33.974593 32433 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:33.974684 32433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:33.974910 32433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:33.976861 32433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "633644083a2a4c059bc8fb2671593e41"
format_stamp: "Formatted at 2026-08-07 22:51:33 on dist-test-slave-tm1g"
server_key: "bd0a6118a9cdfb759ebd6f904e4e76bc"
server_key_iv: "73d55c3086acfdfd5530777d7d72cb89"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.977425 32433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "633644083a2a4c059bc8fb2671593e41"
format_stamp: "Formatted at 2026-08-07 22:51:33 on dist-test-slave-tm1g"
server_key: "bd0a6118a9cdfb759ebd6f904e4e76bc"
server_key_iv: "73d55c3086acfdfd5530777d7d72cb89"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.981038 32433 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 22:51:33.983405 32451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:33.984519 32433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:51:33.984650 32433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "633644083a2a4c059bc8fb2671593e41"
format_stamp: "Formatted at 2026-08-07 22:51:33 on dist-test-slave-tm1g"
server_key: "bd0a6118a9cdfb759ebd6f904e4e76bc"
server_key_iv: "73d55c3086acfdfd5530777d7d72cb89"
server_key_version: "encryptionkey@0"
I20260807 22:51:33.984754 32433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:34.004166 32433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:34.004818 32433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:34.005013 32433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:34.012017 32433 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:43585
I20260807 22:51:34.012027 32507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:43585 every 8 connection(s)
I20260807 22:51:34.012913 32433 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:34.016008 32508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:34.017246 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 32433
I20260807 22:51:34.017377 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:34.017719 12739 external_mini_cluster.cc:1428] Setting key 97204b3283e7d15fb49745ba64645c96
I20260807 22:51:34.022063 32508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41: Bootstrap starting.
I20260807 22:51:34.024695 32508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:34.025447 32508 log.cc:824] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:34.027093 32511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.019097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41144 (local address 127.12.112.254:43585)
0807 22:51:34.019674 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.019689 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.019723 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:51:34.020338 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.020353 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.020720 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.020981 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:34.021305 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.022279 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.023534 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.023987 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.024104 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.024957 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:34.024961 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:34.024972 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:34.025349 (+ 377us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:34.025404 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:34.025423 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:34.025500 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.025695 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.026013 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":135,"threads_started":1}
I20260807 22:51:34.027799 32508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41: No bootstrap required, opened a new log
I20260807 22:51:34.031556 32508 raft_consensus.cc:348] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633644083a2a4c059bc8fb2671593e41" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43585 } }
I20260807 22:51:34.031782 32508 raft_consensus.cc:374] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:34.031872 32508 raft_consensus.cc:729] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 633644083a2a4c059bc8fb2671593e41, State: Initialized, Role: FOLLOWER
I20260807 22:51:34.032267 32508 consensus_queue.cc:260] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633644083a2a4c059bc8fb2671593e41" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43585 } }
I20260807 22:51:34.032414 32508 raft_consensus.cc:388] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:34.032508 32508 raft_consensus.cc:482] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:34.032610 32508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:34.033646 32508 raft_consensus.cc:504] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633644083a2a4c059bc8fb2671593e41" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43585 } }
I20260807 22:51:34.033921 32508 leader_election.cc:302] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 633644083a2a4c059bc8fb2671593e41; no voters:
I20260807 22:51:34.034155 32508 leader_election.cc:288] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:34.034370 32513 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:34.034650 32513 raft_consensus.cc:686] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [term 1 LEADER]: Becoming Leader. State: Replica: 633644083a2a4c059bc8fb2671593e41, State: Running, Role: LEADER
I20260807 22:51:34.034962 32513 consensus_queue.cc:237] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633644083a2a4c059bc8fb2671593e41" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43585 } }
I20260807 22:51:34.035327 32508 sys_catalog.cc:564] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:34.036626 32515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 633644083a2a4c059bc8fb2671593e41. Latest consensus state: current_term: 1 leader_uuid: "633644083a2a4c059bc8fb2671593e41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633644083a2a4c059bc8fb2671593e41" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43585 } } }
I20260807 22:51:34.036677 32514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "633644083a2a4c059bc8fb2671593e41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633644083a2a4c059bc8fb2671593e41" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 43585 } } }
I20260807 22:51:34.036753 32515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:34.036791 32514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:34.037113 32522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:34.039739 32522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:34.045037 32522 catalog_manager.cc:1347] Generated new cluster ID: 08f038ff83f8456e8ba053035500e0ff
I20260807 22:51:34.045097 32522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:34.057641 32522 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:34.058714 32522 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:34.064779 32522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41: Generated new TSK 0
I20260807 22:51:34.065538 32522 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:34.068503 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:43585
--builtin_ntp_servers=127.12.112.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:51:34.178444 32532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:34.178670 32532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:34.178706 32532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:34.182808 32532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:34.182860 32532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:34.182942 32532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:51:34.187659 32532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:34.188737 32532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:34.190140 32532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:34.199733 32538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:34.199738 32540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:34.199738 32537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:34.200011 32532 server_base.cc:1034] running on GCE node
I20260807 22:51:34.200445 32532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:34.201143 32532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:34.202378 32532 hybrid_clock.cc:648] HybridClock initialized: now 1786143094202351 us; error 33 us; skew 500 ppm
I20260807 22:51:34.211726 32532 webserver.cc:460] Webserver started at http://127.12.112.193:36753/ using document root <none> and password file <none>
I20260807 22:51:34.212452 32532 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:34.212569 32532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:34.212826 32532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:34.215224 32532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "8bdc1b330b1048e5855d8abdb61bd72d"
format_stamp: "Formatted at 2026-08-07 22:51:34 on dist-test-slave-tm1g"
server_key: "310a637f4fb8ddc374b6632902f39ded"
server_key_iv: "4e966fa3b1853f8b4ec71eb613f5b987"
server_key_version: "encryptionkey@0"
I20260807 22:51:34.215857 32532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "8bdc1b330b1048e5855d8abdb61bd72d"
format_stamp: "Formatted at 2026-08-07 22:51:34 on dist-test-slave-tm1g"
server_key: "310a637f4fb8ddc374b6632902f39ded"
server_key_iv: "4e966fa3b1853f8b4ec71eb613f5b987"
server_key_version: "encryptionkey@0"
I20260807 22:51:34.219851 32532 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:51:34.222661 32546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:34.223994 32532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:51:34.224151 32532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "8bdc1b330b1048e5855d8abdb61bd72d"
format_stamp: "Formatted at 2026-08-07 22:51:34 on dist-test-slave-tm1g"
server_key: "310a637f4fb8ddc374b6632902f39ded"
server_key_iv: "4e966fa3b1853f8b4ec71eb613f5b987"
server_key_version: "encryptionkey@0"
I20260807 22:51:34.224294 32532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:34.246673 32532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:34.247452 32532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:34.247673 32532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:34.248322 32532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:34.249327 32532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:34.249401 32532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:34.249471 32532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:34.249522 32532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:34.258651 32532 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:40975
I20260807 22:51:34.258690 32666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:40975 every 8 connection(s)
I20260807 22:51:34.259559 32532 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:51:34.265946 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 32532
I20260807 22:51:34.266096 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:51:34.266472 12739 external_mini_cluster.cc:1428] Setting key 1b2049556592f7e95e9c490328d9b7c7
I20260807 22:51:34.268708 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:43585
--builtin_ntp_servers=127.12.112.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:51:34.269425 32511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.261448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:47747 (local address 127.12.112.254:43585)
0807 22:51:34.261628 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.261633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.262698 (+ 1065us) server_negotiation.cc:407] Connection header received
0807 22:51:34.264054 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.264056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.264103 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.264177 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:34.265052 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.265661 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.267264 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.267525 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.267613 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.268896 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:34.268901 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:34.268905 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:34.268922 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:34.268955 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:34.268964 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:34.269030 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.269219 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.269306 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 22:51:34.270596 32669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.261822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:43585 (local address 127.12.112.193:47747)
0807 22:51:34.262552 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:34.262595 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:34.263865 (+ 1270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:34.264342 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:34.264348 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:34.264442 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:34.264912 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.264923 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.265801 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.265807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.267143 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.267153 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.267688 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.267692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.267876 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.268531 (+ 655us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:51:34.268535 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:34.268593 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:51:34.268672 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:34.269057 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:34.269069 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:34.269078 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 22:51:34.269205 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 22:51:34.269520 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":104,"threads_started":1}
I20260807 22:51:34.271912 32667 heartbeater.cc:347] Connected to a master server at 127.12.112.254:43585
I20260807 22:51:34.272142 32667 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:34.272727 32667 heartbeater.cc:511] Master 127.12.112.254:43585 requested a full tablet report, sending...
I20260807 22:51:34.274436 32470 ts_manager.cc:194] Registered new tserver with Master: 8bdc1b330b1048e5855d8abdb61bd72d (127.12.112.193:40975)
I20260807 22:51:34.275691 32470 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.193:47747
W20260807 22:51:34.379154 32670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:34.379395 32670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:34.379432 32670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:34.383523 32670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:34.383570 32670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:34.383644 32670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:51:34.388362 32670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:34.389346 32670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:34.390803 32670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:34.400193 32676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:34.400128 32679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:34.400188 32677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:34.400529 32670 server_base.cc:1034] running on GCE node
I20260807 22:51:34.400926 32670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:34.401579 32670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:34.402735 32670 hybrid_clock.cc:648] HybridClock initialized: now 1786143094402722 us; error 25 us; skew 500 ppm
I20260807 22:51:34.404466 32670 webserver.cc:460] Webserver started at http://127.12.112.194:38245/ using document root <none> and password file <none>
I20260807 22:51:34.405017 32670 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:34.405077 32670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:34.405339 32670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:34.407397 32670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "cc768f330f2d4b27aa1d9657d6e7a240"
format_stamp: "Formatted at 2026-08-07 22:51:34 on dist-test-slave-tm1g"
server_key: "cac01fb10785507487d3ddcd815b7d8f"
server_key_iv: "b30014517ffc2a4ae29e61677d19cf64"
server_key_version: "encryptionkey@0"
I20260807 22:51:34.407976 32670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "cc768f330f2d4b27aa1d9657d6e7a240"
format_stamp: "Formatted at 2026-08-07 22:51:34 on dist-test-slave-tm1g"
server_key: "cac01fb10785507487d3ddcd815b7d8f"
server_key_iv: "b30014517ffc2a4ae29e61677d19cf64"
server_key_version: "encryptionkey@0"
I20260807 22:51:34.411517 32670 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:51:34.413734 32685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:34.414953 32670 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:34.415091 32670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "cc768f330f2d4b27aa1d9657d6e7a240"
format_stamp: "Formatted at 2026-08-07 22:51:34 on dist-test-slave-tm1g"
server_key: "cac01fb10785507487d3ddcd815b7d8f"
server_key_iv: "b30014517ffc2a4ae29e61677d19cf64"
server_key_version: "encryptionkey@0"
I20260807 22:51:34.415198 32670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:34.429800 32670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:34.430483 32670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:34.430685 32670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:34.431226 32670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:34.432114 32670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:34.432185 32670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:34.432255 32670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:34.432298 32670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:34.441294 32670 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:39497
I20260807 22:51:34.441329 336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:39497 every 8 connection(s)
I20260807 22:51:34.442133 32670 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:51:34.446357 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 32670
I20260807 22:51:34.446513 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:51:34.446833 12739 external_mini_cluster.cc:1428] Setting key e0ea359b2daf7a5eadf9f7e7ab7157a5
I20260807 22:51:34.448715 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:43585
--builtin_ntp_servers=127.12.112.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:51:34.451365 32511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.443918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:39701 (local address 127.12.112.254:43585)
0807 22:51:34.444058 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.444062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.445023 (+ 961us) server_negotiation.cc:407] Connection header received
0807 22:51:34.446475 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.446478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.446537 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.446644 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:34.447556 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.448096 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.449330 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.449560 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.449682 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.450909 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:34.450912 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:34.450914 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:34.450925 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:34.450946 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:34.450954 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:34.451016 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.451188 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.451244 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:51:34.452288 340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.444277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:43585 (local address 127.12.112.194:39701)
0807 22:51:34.444881 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:34.444919 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:34.446214 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:34.446821 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:34.446827 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:34.446931 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:34.447416 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.447429 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.448229 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.448233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.449207 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.449217 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.449719 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.449722 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.449887 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.450592 (+ 705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:51:34.450596 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:34.450653 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:51:34.450732 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:34.451039 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:34.451049 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:34.451057 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:51:34.451184 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 22:51:34.451484 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":104,"threads_started":1}
I20260807 22:51:34.453445 338 heartbeater.cc:347] Connected to a master server at 127.12.112.254:43585
I20260807 22:51:34.453679 338 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:34.454190 338 heartbeater.cc:511] Master 127.12.112.254:43585 requested a full tablet report, sending...
I20260807 22:51:34.455257 32470 ts_manager.cc:194] Registered new tserver with Master: cc768f330f2d4b27aa1d9657d6e7a240 (127.12.112.194:39497)
I20260807 22:51:34.456121 32470 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.194:39701
W20260807 22:51:34.557966 341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:34.558195 341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:34.558230 341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:34.562088 341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:34.562135 341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:34.562186 341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:51:34.566992 341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:34.567905 341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:34.569136 341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:34.578145 347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:34.578176 346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:34.578200 349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:34.578588 341 server_base.cc:1034] running on GCE node
I20260807 22:51:34.578924 341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:34.579512 341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:34.580696 341 hybrid_clock.cc:648] HybridClock initialized: now 1786143094580682 us; error 27 us; skew 500 ppm
I20260807 22:51:34.582435 341 webserver.cc:460] Webserver started at http://127.12.112.195:40965/ using document root <none> and password file <none>
I20260807 22:51:34.582978 341 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:34.583069 341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:34.583295 341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:34.585233 341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "16a1c0e47f9b41a7b761a8b9259610f0"
format_stamp: "Formatted at 2026-08-07 22:51:34 on dist-test-slave-tm1g"
server_key: "6b8c1b2e01f61be35765bbacefd5e43b"
server_key_iv: "a1e78b6a8bcb8ca7daeab5bf0655878c"
server_key_version: "encryptionkey@0"
I20260807 22:51:34.585805 341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "16a1c0e47f9b41a7b761a8b9259610f0"
format_stamp: "Formatted at 2026-08-07 22:51:34 on dist-test-slave-tm1g"
server_key: "6b8c1b2e01f61be35765bbacefd5e43b"
server_key_iv: "a1e78b6a8bcb8ca7daeab5bf0655878c"
server_key_version: "encryptionkey@0"
I20260807 22:51:34.589287 341 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 22:51:34.591651 355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:34.592804 341 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:51:34.592932 341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "16a1c0e47f9b41a7b761a8b9259610f0"
format_stamp: "Formatted at 2026-08-07 22:51:34 on dist-test-slave-tm1g"
server_key: "6b8c1b2e01f61be35765bbacefd5e43b"
server_key_iv: "a1e78b6a8bcb8ca7daeab5bf0655878c"
server_key_version: "encryptionkey@0"
I20260807 22:51:34.593035 341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:34.612746 341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:34.613371 341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:34.613554 341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:34.614113 341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:34.615067 341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:34.615137 341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:34.615204 341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:34.615255 341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:34.623996 341 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:36603
I20260807 22:51:34.624039 476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:36603 every 8 connection(s)
I20260807 22:51:34.624898 341 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:51:34.625831 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 341
I20260807 22:51:34.625963 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:51:34.626335 12739 external_mini_cluster.cc:1428] Setting key 41a631042bdc31c97d4f9186c5ffce11
I20260807 22:51:34.635987 32511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.627037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:34215 (local address 127.12.112.254:43585)
0807 22:51:34.627222 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.627228 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.629070 (+ 1842us) server_negotiation.cc:407] Connection header received
0807 22:51:34.630725 (+ 1655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.630728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.630792 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.630878 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:34.631816 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.632462 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.633728 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.633995 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.634120 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.635416 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:34.635421 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:34.635427 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:34.635445 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:34.635471 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:34.635482 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:34.635586 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.635765 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.635834 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:51:34.636955 480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.627573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:43585 (local address 127.12.112.195:34215)
0807 22:51:34.628922 (+ 1349us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:34.628966 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:34.630502 (+ 1536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:34.631053 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:34.631059 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:34.631145 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:34.631653 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.631666 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.632619 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.632624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.633586 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.633596 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.634163 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.634168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.634399 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.635090 (+ 691us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:51:34.635092 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:34.635134 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:51:34.635198 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:34.635588 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:34.635601 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:34.635609 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:51:34.635760 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 22:51:34.636048 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":164,"threads_started":1}
I20260807 22:51:34.638069 477 heartbeater.cc:347] Connected to a master server at 127.12.112.254:43585
I20260807 22:51:34.638291 477 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:34.638852 477 heartbeater.cc:511] Master 127.12.112.254:43585 requested a full tablet report, sending...
I20260807 22:51:34.639991 32470 ts_manager.cc:194] Registered new tserver with Master: 16a1c0e47f9b41a7b761a8b9259610f0 (127.12.112.195:36603)
I20260807 22:51:34.640717 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:51:34.640774 32470 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.195:34215
I20260807 22:51:34.646966 32511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.643241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41150 (local address 127.12.112.254:43585)
0807 22:51:34.643409 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.643420 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.643516 (+ 96us) server_negotiation.cc:407] Connection header received
0807 22:51:34.643615 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.643617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.643652 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.643716 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:34.643932 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.644417 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.645244 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.645476 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.645551 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.646475 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:34.646477 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:34.646479 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:34.646490 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:34.646508 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:34.646515 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:34.646613 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.646754 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.646815 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 22:51:34.649473 32470 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41150:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:51:34.652755 32470 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:51:34.667021 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.661109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40975 (local address 127.0.0.1:47520)
0807 22:51:34.661852 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:34.661897 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:34.662024 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:34.662854 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:34.662860 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:34.662881 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:34.663045 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.663053 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.664137 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.664143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.665389 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.665399 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.666489 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.666493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.666610 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.666660 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 22:51:34.666742 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:51:34.666863 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"mutex_wait_us":27,"thread_start_us":79,"threads_started":1}
I20260807 22:51:34.667259 492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.661201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:39497 (local address 127.0.0.1:49952)
0807 22:51:34.661952 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:34.661969 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:34.662061 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:34.662959 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:34.662962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:34.662975 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:34.663189 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.663195 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.664642 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.664646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.665747 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.665756 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.666829 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.666834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.666940 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.666968 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 22:51:34.667052 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 22:51:34.667116 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":121,"thread_start_us":111,"threads_started":1}
I20260807 22:51:34.667623 490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.661464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:36603 (local address 127.0.0.1:60522)
0807 22:51:34.663204 (+ 1740us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:34.663215 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:34.663335 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:34.663826 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:34.663830 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:34.663848 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:34.663925 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.663930 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.665133 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.665136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.666159 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.666168 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.667217 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.667221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.667330 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.667360 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 22:51:34.667434 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:51:34.667505 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1690,"mutex_wait_us":1,"thread_start_us":70,"threads_started":1}
I20260807 22:51:34.667817 494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.661867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49952 (local address 127.12.112.194:39497)
0807 22:51:34.662481 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.662492 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.662521 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:51:34.662606 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.662611 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.662825 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.662979 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:34.663326 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.664512 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.665889 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.666682 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.666817 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.666980 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.667524 (+ 544us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.667627 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":133,"threads_started":1}
I20260807 22:51:34.668020 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.661274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47520 (local address 127.12.112.193:40975)
0807 22:51:34.662328 (+ 1054us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.662341 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.662369 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:51:34.662469 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.662475 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.662672 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.662854 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:34.663134 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.664031 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.665529 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.666354 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.667431 (+ 1077us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.667572 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.667611 (+ 39us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.667844 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":929,"thread_start_us":133,"threads_started":1}
I20260807 22:51:34.668061 493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.661847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60522 (local address 127.12.112.195:36603)
0807 22:51:34.662336 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.662347 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.663440 (+ 1093us) server_negotiation.cc:407] Connection header received
0807 22:51:34.663517 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.663522 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.663682 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.663830 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:34.664039 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.664973 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.666284 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.666872 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.666988 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.667157 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.667799 (+ 642us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.667907 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":146,"threads_started":1}
I20260807 22:51:34.670480 32738 tablet_service.cc:1467] Processing CreateTablet for tablet 11ec64bacf014fde80db885580bbbab1 (DEFAULT_TABLE table=test-table [id=77d52d1d837a42cca5b03c07a898fa2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:34.670647 405 tablet_service.cc:1467] Processing CreateTablet for tablet 11ec64bacf014fde80db885580bbbab1 (DEFAULT_TABLE table=test-table [id=77d52d1d837a42cca5b03c07a898fa2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:34.670647 32596 tablet_service.cc:1467] Processing CreateTablet for tablet 11ec64bacf014fde80db885580bbbab1 (DEFAULT_TABLE table=test-table [id=77d52d1d837a42cca5b03c07a898fa2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:34.671461 32738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ec64bacf014fde80db885580bbbab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:34.671625 32596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ec64bacf014fde80db885580bbbab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:34.671625 405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ec64bacf014fde80db885580bbbab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:34.677897 495 tablet_bootstrap.cc:492] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: Bootstrap starting.
I20260807 22:51:34.679144 497 tablet_bootstrap.cc:492] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: Bootstrap starting.
I20260807 22:51:34.679137 496 tablet_bootstrap.cc:492] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d: Bootstrap starting.
I20260807 22:51:34.680250 495 tablet_bootstrap.cc:654] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:34.680939 497 tablet_bootstrap.cc:654] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:34.681092 496 tablet_bootstrap.cc:654] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:34.681119 495 log.cc:824] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:34.681722 497 log.cc:824] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:34.681821 496 log.cc:824] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:34.683357 495 tablet_bootstrap.cc:492] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: No bootstrap required, opened a new log
I20260807 22:51:34.683555 495 ts_tablet_manager.cc:1397] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:51:34.683794 496 tablet_bootstrap.cc:492] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d: No bootstrap required, opened a new log
I20260807 22:51:34.683881 497 tablet_bootstrap.cc:492] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: No bootstrap required, opened a new log
I20260807 22:51:34.683985 496 ts_tablet_manager.cc:1397] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 22:51:34.684082 497 ts_tablet_manager.cc:1397] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 22:51:34.687088 497 raft_consensus.cc:348] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 } } peers { permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 } } peers { permanent_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36603 } }
I20260807 22:51:34.687325 497 raft_consensus.cc:374] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:34.687381 497 raft_consensus.cc:729] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16a1c0e47f9b41a7b761a8b9259610f0, State: Initialized, Role: FOLLOWER
I20260807 22:51:34.687829 497 consensus_queue.cc:260] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 } } peers { permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 } } peers { permanent_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36603 } }
I20260807 22:51:34.687856 495 raft_consensus.cc:348] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 } } peers { permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 } } peers { permanent_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36603 } }
I20260807 22:51:34.688176 495 raft_consensus.cc:374] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:34.687980 496 raft_consensus.cc:348] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 } } peers { permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 } } peers { permanent_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36603 } }
I20260807 22:51:34.688237 495 raft_consensus.cc:729] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc768f330f2d4b27aa1d9657d6e7a240, State: Initialized, Role: FOLLOWER
I20260807 22:51:34.688251 496 raft_consensus.cc:374] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:34.688315 496 raft_consensus.cc:729] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bdc1b330b1048e5855d8abdb61bd72d, State: Initialized, Role: FOLLOWER
I20260807 22:51:34.688627 477 heartbeater.cc:503] Master 127.12.112.254:43585 was elected leader, sending a full tablet report...
I20260807 22:51:34.688699 495 consensus_queue.cc:260] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 } } peers { permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 } } peers { permanent_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36603 } }
I20260807 22:51:34.688699 496 consensus_queue.cc:260] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 } } peers { permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 } } peers { permanent_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36603 } }
I20260807 22:51:34.688830 497 ts_tablet_manager.cc:1428] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:51:34.689582 32667 heartbeater.cc:503] Master 127.12.112.254:43585 was elected leader, sending a full tablet report...
I20260807 22:51:34.689657 495 ts_tablet_manager.cc:1428] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:51:34.689657 496 ts_tablet_manager.cc:1428] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:51:34.690490 338 heartbeater.cc:503] Master 127.12.112.254:43585 was elected leader, sending a full tablet report...
W20260807 22:51:34.693113 339 tablet.cc:2369] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:51:34.716382 501 raft_consensus.cc:482] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:34.716569 501 raft_consensus.cc:504] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 } } peers { permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 } } peers { permanent_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36603 } }
I20260807 22:51:34.717723 501 leader_election.cc:288] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bdc1b330b1048e5855d8abdb61bd72d (127.12.112.193:40975), cc768f330f2d4b27aa1d9657d6e7a240 (127.12.112.194:39497)
I20260807 22:51:34.721742 480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.717902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40975 (local address 127.12.112.195:41363)
0807 22:51:34.718079 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:34.718096 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:34.718195 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:34.718514 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:34.718517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:34.718538 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:34.718676 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.718687 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.719486 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.719489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.720449 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.720458 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.721312 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.721316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.721413 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.721438 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:51:34.721516 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:51:34.721586 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":3}
I20260807 22:51:34.721760 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.718053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:41363 (local address 127.12.112.193:40975)
0807 22:51:34.718211 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.718216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.718268 (+ 52us) server_negotiation.cc:407] Connection header received
0807 22:51:34.718347 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.718352 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.718408 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.718469 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:34.718815 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.719379 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.720579 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.721168 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.721288 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.721352 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.721550 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.721631 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:51:34.722394 32617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ec64bacf014fde80db885580bbbab1" candidate_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" is_pre_election: true
I20260807 22:51:34.722502 494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.718242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:55431 (local address 127.12.112.194:39497)
0807 22:51:34.718390 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.718395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.718629 (+ 234us) server_negotiation.cc:407] Connection header received
0807 22:51:34.718706 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.718708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.718748 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.718838 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:34.719106 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.719843 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.721043 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.721619 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.721716 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.721758 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.722333 (+ 575us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.722401 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:51:34.722523 504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.718046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:39497 (local address 127.12.112.195:55431)
0807 22:51:34.718524 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:34.718536 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:34.718627 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:34.718851 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:34.718854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:34.718869 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:34.718992 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.718997 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.719963 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.719966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.720894 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:34.720904 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.722064 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.722068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:34.722166 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.722188 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:51:34.722288 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 22:51:34.722374 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":21,"thread_start_us":124,"threads_started":1}
I20260807 22:51:34.722702 32617 raft_consensus.cc:2454] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16a1c0e47f9b41a7b761a8b9259610f0 in term 0.
I20260807 22:51:34.723169 32758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ec64bacf014fde80db885580bbbab1" candidate_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" is_pre_election: true
I20260807 22:51:34.723240 359 leader_election.cc:302] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16a1c0e47f9b41a7b761a8b9259610f0, 8bdc1b330b1048e5855d8abdb61bd72d; no voters:
I20260807 22:51:34.723413 32758 raft_consensus.cc:2454] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16a1c0e47f9b41a7b761a8b9259610f0 in term 0.
I20260807 22:51:34.723588 501 raft_consensus.cc:2781] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:51:34.723682 501 raft_consensus.cc:482] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:51:34.723742 501 raft_consensus.cc:3037] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:34.724797 501 raft_consensus.cc:504] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 } } peers { permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 } } peers { permanent_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36603 } }
I20260807 22:51:34.725142 501 leader_election.cc:288] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [CANDIDATE]: Term 1 election: Requested vote from peers 8bdc1b330b1048e5855d8abdb61bd72d (127.12.112.193:40975), cc768f330f2d4b27aa1d9657d6e7a240 (127.12.112.194:39497)
I20260807 22:51:34.725512 32617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ec64bacf014fde80db885580bbbab1" candidate_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bdc1b330b1048e5855d8abdb61bd72d"
I20260807 22:51:34.725535 32758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ec64bacf014fde80db885580bbbab1" candidate_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc768f330f2d4b27aa1d9657d6e7a240"
I20260807 22:51:34.725636 32617 raft_consensus.cc:3037] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:34.725636 32758 raft_consensus.cc:3037] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:34.726914 32617 raft_consensus.cc:2454] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16a1c0e47f9b41a7b761a8b9259610f0 in term 1.
I20260807 22:51:34.726914 32758 raft_consensus.cc:2454] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16a1c0e47f9b41a7b761a8b9259610f0 in term 1.
I20260807 22:51:34.727236 359 leader_election.cc:302] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 16a1c0e47f9b41a7b761a8b9259610f0, 8bdc1b330b1048e5855d8abdb61bd72d, cc768f330f2d4b27aa1d9657d6e7a240; no voters:
I20260807 22:51:34.727422 501 raft_consensus.cc:2781] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:34.727612 501 raft_consensus.cc:686] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 1 LEADER]: Becoming Leader. State: Replica: 16a1c0e47f9b41a7b761a8b9259610f0, State: Running, Role: LEADER
I20260807 22:51:34.727916 501 consensus_queue.cc:237] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 } } peers { permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 } } peers { permanent_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36603 } }
I20260807 22:51:34.731153 32469 catalog_manager.cc:5495] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16a1c0e47f9b41a7b761a8b9259610f0 (127.12.112.195). New cstate: current_term: 1 leader_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16a1c0e47f9b41a7b761a8b9259610f0" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260807 22:51:34.745117 493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.741802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60526 (local address 127.12.112.195:36603)
0807 22:51:34.741920 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:34.741923 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:34.741936 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:51:34.742028 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:34.742030 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:34.742075 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:34.742156 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:51:34.742428 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.742975 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.743808 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:34.744014 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:34.744088 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:34.744410 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:51:34.744778 (+ 368us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:51:34.744896 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:34.744988 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 22:51:34.745017 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:51:34.750537 32758 raft_consensus.cc:1261] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240 [term 1 FOLLOWER]: Refusing update from remote peer 16a1c0e47f9b41a7b761a8b9259610f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:34.750562 32617 raft_consensus.cc:1261] T 11ec64bacf014fde80db885580bbbab1 P 8bdc1b330b1048e5855d8abdb61bd72d [term 1 FOLLOWER]: Refusing update from remote peer 16a1c0e47f9b41a7b761a8b9259610f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:34.751274 501 consensus_queue.cc:1035] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc768f330f2d4b27aa1d9657d6e7a240" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:34.751442 505 consensus_queue.cc:1035] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bdc1b330b1048e5855d8abdb61bd72d" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 40975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:34.759059 508 mvcc.cc:205] Tried to move back new op lower bound from 7316042116091486208 to 7316042116008194048. Current Snapshot: MvccSnapshot[applied={T|T < 7316042116091486208}]
I20260807 22:51:34.761824 509 mvcc.cc:205] Tried to move back new op lower bound from 7316042116091486208 to 7316042116008194048. Current Snapshot: MvccSnapshot[applied={T|T < 7316042116091486208}]
I20260807 22:51:34.767625 32470 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:34.767787 32470 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:34.770241 32470 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 633644083a2a4c059bc8fb2671593e41: Sending DeleteTablet for 3 replicas of tablet 11ec64bacf014fde80db885580bbbab1
I20260807 22:51:34.770994 32596 tablet_service.cc:1514] Processing DeleteTablet for tablet 11ec64bacf014fde80db885580bbbab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:34 UTC) from {username='slave'} at 127.0.0.1:47520
I20260807 22:51:34.771070 32738 tablet_service.cc:1514] Processing DeleteTablet for tablet 11ec64bacf014fde80db885580bbbab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:34 UTC) from {username='slave'} at 127.0.0.1:49952
I20260807 22:51:34.771142 405 tablet_service.cc:1514] Processing DeleteTablet for tablet 11ec64bacf014fde80db885580bbbab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:34 UTC) from {username='slave'} at 127.0.0.1:60522
I20260807 22:51:34.771895 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 32532
I20260807 22:51:34.774185 520 tablet_replica.cc:330] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: stopping tablet replica
I20260807 22:51:34.774981 520 raft_consensus.cc:2229] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:51:34.775285 520 raft_consensus.cc:2258] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:34.776747 520 ts_tablet_manager.cc:1905] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:34.780331 520 ts_tablet_manager.cc:1918] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:34.780438 520 log.cc:1196] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/11ec64bacf014fde80db885580bbbab1
I20260807 22:51:34.780700 519 tablet_replica.cc:330] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: stopping tablet replica
I20260807 22:51:34.780844 520 ts_tablet_manager.cc:1939] T 11ec64bacf014fde80db885580bbbab1 P cc768f330f2d4b27aa1d9657d6e7a240: Deleting consensus metadata
I20260807 22:51:34.781096 519 raft_consensus.cc:2229] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:51:34.781461 519 raft_consensus.cc:2258] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:34.782184 32455 catalog_manager.cc:4841] TS cc768f330f2d4b27aa1d9657d6e7a240 (127.12.112.194:39497): tablet 11ec64bacf014fde80db885580bbbab1 (table test-table [id=77d52d1d837a42cca5b03c07a898fa2d]) successfully deleted
W20260807 22:51:34.782397 32456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:40975 (error 108)
I20260807 22:51:34.782958 519 ts_tablet_manager.cc:1905] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:34.783226 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 32670
I20260807 22:51:34.783371 490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:34.783097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:40975 (local address 127.0.0.1:47530)
0807 22:51:34.783222 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:34.783295 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 22:51:34.784240 32456 catalog_manager.cc:4584] TS 8bdc1b330b1048e5855d8abdb61bd72d (127.12.112.193:40975): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 11ec64bacf014fde80db885580bbbab1: Network error: Client connection negotiation failed: client connection to 127.12.112.193:40975: connect: Connection refused (error 111)
I20260807 22:51:34.786176 519 ts_tablet_manager.cc:1918] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:34.786268 519 log.cc:1196] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/11ec64bacf014fde80db885580bbbab1
I20260807 22:51:34.786610 519 ts_tablet_manager.cc:1939] T 11ec64bacf014fde80db885580bbbab1 P 16a1c0e47f9b41a7b761a8b9259610f0: Deleting consensus metadata
I20260807 22:51:34.787694 32452 catalog_manager.cc:4841] TS 16a1c0e47f9b41a7b761a8b9259610f0 (127.12.112.195:36603): tablet 11ec64bacf014fde80db885580bbbab1 (table test-table [id=77d52d1d837a42cca5b03c07a898fa2d]) successfully deleted
I20260807 22:51:34.790141 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 341
I20260807 22:51:34.795601 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 32433
2026-08-07T22:51:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (984 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:34 dist-test-slave-tm1g krb5kdc[524](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:34 dist-test-slave-tm1g krb5kdc[524](info): set up 2 sockets
Aug 07 22:51:34 dist-test-slave-tm1g krb5kdc[524](info): commencing operation
krb5kdc: starting...
W20260807 22:51:35.853423 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:35 dist-test-slave-tm1g krb5kdc[524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:51:35.979031 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:38411
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:38411
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:36.087954 538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:36.088188 538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:36.088246 538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:36.092218 538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:36.092267 538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:36.092286 538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:36.092356 538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:36.092387 538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:36.097527 538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:38411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:38411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:36.098527 538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:36.099536 538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:36.107649 547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:36.107674 545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:36.107836 538 server_base.cc:1034] running on GCE node
W20260807 22:51:36.107689 544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:36.108496 538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:36.109462 538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:36.110620 538 hybrid_clock.cc:648] HybridClock initialized: now 1786143096110591 us; error 41 us; skew 500 ppm
Aug 07 22:51:36 dist-test-slave-tm1g krb5kdc[524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143096, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:36.113229 538 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:51:36.114032 538 webserver.cc:460] Webserver started at http://127.12.112.254:45199/ using document root <none> and password file <none>
I20260807 22:51:36.114598 538 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:36.114660 538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:36.114830 538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:36.116768 538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "2aede3d105ef4ecda13ffd0b2f3982a2"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "39df99da57210e0ba66ee649c98ff5cc"
server_key_iv: "05736efd726ee88bf6414dd168af3188"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.117285 538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "2aede3d105ef4ecda13ffd0b2f3982a2"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "39df99da57210e0ba66ee649c98ff5cc"
server_key_iv: "05736efd726ee88bf6414dd168af3188"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.120779 538 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 22:51:36.123028 554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:36.124295 538 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:36.124430 538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "2aede3d105ef4ecda13ffd0b2f3982a2"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "39df99da57210e0ba66ee649c98ff5cc"
server_key_iv: "05736efd726ee88bf6414dd168af3188"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.124538 538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:36.146790 538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:36.150004 538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:36.150214 538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:36.157435 538 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:38411
I20260807 22:51:36.157460 608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:38411 every 8 connection(s)
I20260807 22:51:36.158476 538 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:36.161131 609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:36.164767 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 538
I20260807 22:51:36.164918 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:36.165293 12739 external_mini_cluster.cc:1428] Setting key 13f5b3f07d0b24218c44cc63e3a5dfe6
I20260807 22:51:36.167070 609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2: Bootstrap starting.
I20260807 22:51:36.169513 609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:36.170266 609 log.cc:824] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:36.172350 609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2: No bootstrap required, opened a new log
Aug 07 22:51:36 dist-test-slave-tm1g krb5kdc[524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:36.176889 609 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aede3d105ef4ecda13ffd0b2f3982a2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38411 } }
I20260807 22:51:36.177182 609 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:36.177245 609 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aede3d105ef4ecda13ffd0b2f3982a2, State: Initialized, Role: FOLLOWER
I20260807 22:51:36.177716 609 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aede3d105ef4ecda13ffd0b2f3982a2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38411 } }
I20260807 22:51:36.177903 609 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:36.177977 609 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:36.178072 609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:36.179196 609 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aede3d105ef4ecda13ffd0b2f3982a2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38411 } }
I20260807 22:51:36.179539 609 leader_election.cc:302] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2aede3d105ef4ecda13ffd0b2f3982a2; no voters:
I20260807 22:51:36.179872 609 leader_election.cc:288] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:36.179986 614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:36.180121 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.166708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43010 (local address 127.12.112.254:38411)
0807 22:51:36.167107 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:36.167142 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:36.167189 (+ 47us) server_negotiation.cc:407] Connection header received
0807 22:51:36.167803 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:36.167818 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:36.168135 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:36.168413 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:36.169285 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.170472 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.171585 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.172040 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.172151 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.174887 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:36.174895 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:36.174914 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:36.174955 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:36.176922 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:36.177433 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:36.177438 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:36.177444 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:36.177580 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:36.177851 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:36.177855 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:36.177858 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:36.178419 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:36.178615 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:36.178833 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 22:51:36.179150 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":133,"threads_started":1}
I20260807 22:51:36.180199 614 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [term 1 LEADER]: Becoming Leader. State: Replica: 2aede3d105ef4ecda13ffd0b2f3982a2, State: Running, Role: LEADER
I20260807 22:51:36.180516 614 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aede3d105ef4ecda13ffd0b2f3982a2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38411 } }
I20260807 22:51:36.181111 609 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:36.182849 617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2aede3d105ef4ecda13ffd0b2f3982a2. Latest consensus state: current_term: 1 leader_uuid: "2aede3d105ef4ecda13ffd0b2f3982a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aede3d105ef4ecda13ffd0b2f3982a2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38411 } } }
I20260807 22:51:36.182963 617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:36.183431 615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2aede3d105ef4ecda13ffd0b2f3982a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aede3d105ef4ecda13ffd0b2f3982a2" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38411 } } }
I20260807 22:51:36.183367 630 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:36.183589 615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:36.186111 630 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:36.191366 630 catalog_manager.cc:1347] Generated new cluster ID: de6d0bcfbe7b46cfa99f74cfb3c7dc66
I20260807 22:51:36.191426 630 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:36.207183 630 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:36.208081 630 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:36.214721 630 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2: Generated new TSK 0
I20260807 22:51:36.215463 630 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.112.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
Entry for principal kudu/127.12.112.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab.
I20260807 22:51:36.253320 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:38411
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:36.367146 637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:36.367447 637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:36.367527 637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:36.371703 637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:36.371788 637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:36.371886 637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:51:36.377120 637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.193.keytab
--principal=kudu/127.12.112.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:38411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:36.378206 637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:36.379323 637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:36.389137 645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:36.389217 643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:36.389313 637 server_base.cc:1034] running on GCE node
W20260807 22:51:36.389142 642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:36.389775 637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:36.390463 637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:36.391633 637 hybrid_clock.cc:648] HybridClock initialized: now 1786143096391600 us; error 42 us; skew 500 ppm
Aug 07 22:51:36 dist-test-slave-tm1g krb5kdc[524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143096, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:36.394474 637 init.cc:377] Logged in from keytab as kudu/127.12.112.193@KRBTEST.COM (short username kudu)
I20260807 22:51:36.395257 637 webserver.cc:460] Webserver started at http://127.12.112.193:43625/ using document root <none> and password file <none>
I20260807 22:51:36.395772 637 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:36.395840 637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:36.396000 637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:36.397960 637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "b6961e753eb14ba39b56bf59b96fbfed"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "854b304270241aab1e104782f14260fb"
server_key_iv: "c1d27adbf0c3c4cb0458500e2697e699"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.398573 637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "b6961e753eb14ba39b56bf59b96fbfed"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "854b304270241aab1e104782f14260fb"
server_key_iv: "c1d27adbf0c3c4cb0458500e2697e699"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.402186 637 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:51:36.404523 653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:36.405751 637 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:36.405879 637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "b6961e753eb14ba39b56bf59b96fbfed"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "854b304270241aab1e104782f14260fb"
server_key_iv: "c1d27adbf0c3c4cb0458500e2697e699"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.405984 637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:36.416877 637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:36.420037 637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:36.420243 637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:36.420838 637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:36.421653 637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:36.421697 637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:36.421765 637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:36.421797 637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:36.431406 637 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:37553
I20260807 22:51:36.431432 772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:37553 every 8 connection(s)
I20260807 22:51:36.432288 637 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:51:36.440182 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 637
I20260807 22:51:36.440356 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:51:36.440726 12739 external_mini_cluster.cc:1428] Setting key af611a685a0e3081343a6da8db684ad1
Aug 07 22:51:36 dist-test-slave-tm1g krb5kdc[524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143096, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.193@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:36.446941 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.434107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:37907 (local address 127.12.112.254:38411)
0807 22:51:36.434252 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:36.434256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:36.435123 (+ 867us) server_negotiation.cc:407] Connection header received
0807 22:51:36.436499 (+ 1376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:36.436502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:36.436565 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:36.436674 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:36.437812 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.438438 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.439594 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.439832 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.439955 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.442965 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:36.442969 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:36.442970 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:36.442994 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:36.444590 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:36.445106 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:36.445111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:36.445114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:36.445216 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:36.445602 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:36.445607 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:36.445610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:36.445882 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:36.445986 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:36.446532 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 22:51:36.446675 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:51:36.447654 775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.434517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:38411 (local address 127.12.112.193:37907)
0807 22:51:36.434956 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:36.435000 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:36.436276 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:36.436848 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:36.436855 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:36.437196 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:36.437661 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.437674 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.438567 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.438570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.439451 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.439461 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.440001 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.440005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.440181 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.440922 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:36.440938 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:36.442752 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:36.444718 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:36.444723 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:36.444734 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:36.445004 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:36.445351 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:36.445353 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:36.445355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:36.445501 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:36.445992 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:36.445997 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:36.446230 (+ 233us) client_negotiation.cc:769] Sending connection context
0807 22:51:36.446459 (+ 229us) client_negotiation.cc:240] Negotiation successful
0807 22:51:36.446720 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":111,"threads_started":1}
I20260807 22:51:36.448953 773 heartbeater.cc:347] Connected to a master server at 127.12.112.254:38411
I20260807 22:51:36.449221 773 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:36.449815 773 heartbeater.cc:511] Master 127.12.112.254:38411 requested a full tablet report, sending...
I20260807 22:51:36.451390 572 ts_manager.cc:194] Registered new tserver with Master: b6961e753eb14ba39b56bf59b96fbfed (127.12.112.193:37553)
WARNING: no policy specified for kudu/127.12.112.194@KRBTEST.COM; defaulting to no policy
I20260807 22:51:36.452566 572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.193@KRBTEST.COM'} at 127.12.112.193:37907
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
Entry for principal kudu/127.12.112.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab.
I20260807 22:51:36.469543 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:38411
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:36.579564 778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:36.579820 778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:36.579864 778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:36.584206 778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:36.584261 778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:36.584362 778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:51:36.589664 778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.194.keytab
--principal=kudu/127.12.112.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:38411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:36.590727 778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:36.591741 778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:36.601370 783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:36.601423 784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:36.601388 786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:36.601444 778 server_base.cc:1034] running on GCE node
I20260807 22:51:36.601961 778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:36.602629 778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:36.603794 778 hybrid_clock.cc:648] HybridClock initialized: now 1786143096603781 us; error 25 us; skew 500 ppm
Aug 07 22:51:36 dist-test-slave-tm1g krb5kdc[524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143096, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:36.606593 778 init.cc:377] Logged in from keytab as kudu/127.12.112.194@KRBTEST.COM (short username kudu)
I20260807 22:51:36.607371 778 webserver.cc:460] Webserver started at http://127.12.112.194:40351/ using document root <none> and password file <none>
I20260807 22:51:36.607874 778 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:36.607932 778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:36.608093 778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:36.610198 778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "915395f7e180490ba176ca11fc087820"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "501cf1ae71a07a1289ab5407c56d6020"
server_key_iv: "78e785ea11ff273a73db8d17473a6e05"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.610823 778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "915395f7e180490ba176ca11fc087820"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "501cf1ae71a07a1289ab5407c56d6020"
server_key_iv: "78e785ea11ff273a73db8d17473a6e05"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.614513 778 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:51:36.616858 793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:36.618040 778 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:36.618165 778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "915395f7e180490ba176ca11fc087820"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "501cf1ae71a07a1289ab5407c56d6020"
server_key_iv: "78e785ea11ff273a73db8d17473a6e05"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.618269 778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:36.635010 778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:36.638397 778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:36.638613 778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:36.639240 778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:36.640129 778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:36.640175 778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:36.640215 778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:36.640230 778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:36.649068 778 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:39517
I20260807 22:51:36.649098 911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:39517 every 8 connection(s)
I20260807 22:51:36.649966 778 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:51:36.656206 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 778
I20260807 22:51:36.656373 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:51:36.656705 12739 external_mini_cluster.cc:1428] Setting key 7a36db845b8a5038a3817e2def474a0a
Aug 07 22:51:36 dist-test-slave-tm1g krb5kdc[524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143096, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.194@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:36.664857 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.651767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:49213 (local address 127.12.112.254:38411)
0807 22:51:36.651926 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:36.651931 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:36.652674 (+ 743us) server_negotiation.cc:407] Connection header received
0807 22:51:36.654088 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:36.654091 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:36.654151 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:36.654259 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:36.655540 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.656231 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.657635 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.658023 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.658134 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.660687 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:36.660693 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:36.660698 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:36.660729 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:36.662455 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:36.663008 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:36.663015 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:36.663020 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:36.663127 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:36.663542 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:36.663549 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:36.663550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:36.663821 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:36.663933 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:36.664455 (+ 522us) server_negotiation.cc:299] Negotiation successful
0807 22:51:36.664606 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 22:51:36.665616 915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.652047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:38411 (local address 127.12.112.194:49213)
0807 22:51:36.652526 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:36.652568 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:36.653863 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:36.654457 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:36.654464 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:36.654832 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:36.655391 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.655406 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.656406 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.656427 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.657517 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.657527 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.658174 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.658177 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.658393 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.659017 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:36.659034 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:36.660506 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:36.662589 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:36.662594 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:36.662606 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:36.662893 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:36.663271 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:36.663274 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:36.663275 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:36.663435 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:36.663947 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:36.663952 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:36.664195 (+ 243us) client_negotiation.cc:769] Sending connection context
0807 22:51:36.664363 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 22:51:36.664644 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":113,"threads_started":1}
I20260807 22:51:36.666939 912 heartbeater.cc:347] Connected to a master server at 127.12.112.254:38411
I20260807 22:51:36.667169 912 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:36.667670 912 heartbeater.cc:511] Master 127.12.112.254:38411 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.112.195@KRBTEST.COM; defaulting to no policy
I20260807 22:51:36.668788 572 ts_manager.cc:194] Registered new tserver with Master: 915395f7e180490ba176ca11fc087820 (127.12.112.194:39517)
I20260807 22:51:36.669392 572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.194@KRBTEST.COM'} at 127.12.112.194:49213
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
Entry for principal kudu/127.12.112.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab.
I20260807 22:51:36.685433 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:38411
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:33235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:36.795933 918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:36.796165 918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:36.796207 918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:36.800221 918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:36.800273 918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:36.800366 918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:51:36.805522 918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:33235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.195.keytab
--principal=kudu/127.12.112.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:38411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:36.806535 918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:36.807578 918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:36.817302 926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:36.817346 918 server_base.cc:1034] running on GCE node
W20260807 22:51:36.817267 927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:36.817310 929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:36.817951 918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:36.818665 918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:36.819840 918 hybrid_clock.cc:648] HybridClock initialized: now 1786143096819816 us; error 37 us; skew 500 ppm
Aug 07 22:51:36 dist-test-slave-tm1g krb5kdc[524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143096, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:36.822767 918 init.cc:377] Logged in from keytab as kudu/127.12.112.195@KRBTEST.COM (short username kudu)
I20260807 22:51:36.823657 918 webserver.cc:460] Webserver started at http://127.12.112.195:43839/ using document root <none> and password file <none>
I20260807 22:51:36.824203 918 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:36.824301 918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:36.824533 918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:36.826637 918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "61d65664472c4cc69a1edc00eda895b5"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "8c2ac8a85a4ff19016720fc849705131"
server_key_iv: "34bde94d914f99eba20b7d59c59fd2af"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.827250 918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "61d65664472c4cc69a1edc00eda895b5"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "8c2ac8a85a4ff19016720fc849705131"
server_key_iv: "34bde94d914f99eba20b7d59c59fd2af"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.831076 918 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 22:51:36.833432 936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:36.834878 918 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:36.835008 918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "61d65664472c4cc69a1edc00eda895b5"
format_stamp: "Formatted at 2026-08-07 22:51:36 on dist-test-slave-tm1g"
server_key: "8c2ac8a85a4ff19016720fc849705131"
server_key_iv: "34bde94d914f99eba20b7d59c59fd2af"
server_key_version: "encryptionkey@0"
I20260807 22:51:36.835126 918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:36.851143 918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:36.854012 918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:36.854215 918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:36.854837 918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:36.855639 918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:36.855684 918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:36.855748 918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:36.855790 918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:36.864959 918 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:42063
I20260807 22:51:36.864988 1054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:42063 every 8 connection(s)
I20260807 22:51:36.865839 918 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:51:36.871694 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 918
I20260807 22:51:36.871829 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:51:36.872133 12739 external_mini_cluster.cc:1428] Setting key a600e2827065dbba3c5825e2635a7b1b
Aug 07 22:51:36 dist-test-slave-tm1g krb5kdc[524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143096, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.195@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:36.879422 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.867647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:47233 (local address 127.12.112.254:38411)
0807 22:51:36.867803 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:36.867807 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:36.868601 (+ 794us) server_negotiation.cc:407] Connection header received
0807 22:51:36.869957 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:36.869961 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:36.870020 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:36.870138 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:36.871290 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.871929 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.873295 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.873540 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.873637 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.876122 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:36.876125 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:36.876127 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:36.876150 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:36.877471 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:36.877935 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:36.877946 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:36.877947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:36.878026 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:36.878451 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:36.878454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:36.878455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:36.878634 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:36.878716 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:36.879171 (+ 455us) server_negotiation.cc:299] Negotiation successful
0807 22:51:36.879287 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:51:36.880182 1057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.868009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:38411 (local address 127.12.112.195:47233)
0807 22:51:36.868449 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:36.868492 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:36.869743 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:36.870321 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:36.870327 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:36.870667 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:36.871137 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.871149 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.872053 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.872057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.873173 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.873183 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.873697 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.873700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.873849 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.874531 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:51:36.874547 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:36.875958 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:36.877581 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:36.877585 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:36.877596 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:36.877845 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:36.878139 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:51:36.878142 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:51:36.878143 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:51:36.878359 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:51:36.878732 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:36.878737 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:36.878962 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 22:51:36.879108 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 22:51:36.879370 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":109,"threads_started":1}
I20260807 22:51:36.881290 1055 heartbeater.cc:347] Connected to a master server at 127.12.112.254:38411
I20260807 22:51:36.881557 1055 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:36.882113 1055 heartbeater.cc:511] Master 127.12.112.254:38411 requested a full tablet report, sending...
I20260807 22:51:36.883215 572 ts_manager.cc:194] Registered new tserver with Master: 61d65664472c4cc69a1edc00eda895b5 (127.12.112.195:42063)
I20260807 22:51:36.883795 572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.112.195@KRBTEST.COM'} at 127.12.112.195:47233
I20260807 22:51:36.886196 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:51:36.894935 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.888227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.12.112.254:38411)
0807 22:51:36.888347 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:36.888351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:36.888535 (+ 184us) server_negotiation.cc:407] Connection header received
0807 22:51:36.888632 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:36.888635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:36.888671 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:36.888734 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:36.889390 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.889879 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.890738 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.890950 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.891025 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.892248 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:36.892251 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:36.892254 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:36.892275 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:36.893490 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:36.893865 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:36.893867 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:36.893868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:36.893938 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:36.894159 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:36.894161 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:36.894162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:36.894426 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:36.894527 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:36.894723 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 22:51:36.894812 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:51:36.897728 572 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:51:36.901121 572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:51:36.915360 1070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.910032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:37553 (local address 127.0.0.1:49604)
0807 22:51:36.910580 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:36.910596 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:36.910668 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:36.911215 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:36.911221 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:36.911244 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:36.911541 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.911557 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.912572 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.912578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.913871 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.913882 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.914893 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.914896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.914985 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.915020 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 22:51:36.915086 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 22:51:36.915168 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":81,"spinlock_wait_cycles":1408,"thread_start_us":100,"threads_started":1}
I20260807 22:51:36.915652 1067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.909346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:39517 (local address 127.0.0.1:53848)
0807 22:51:36.909822 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:36.909941 (+ 119us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:36.910069 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:36.911229 (+ 1160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:36.911232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:36.911260 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:36.911490 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.911497 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.913045 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.913048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.914117 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.914124 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.915245 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.915249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.915345 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.915368 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:51:36.915450 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:51:36.915530 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":27,"spinlock_wait_cycles":896,"thread_start_us":69,"threads_started":1}
I20260807 22:51:36.915997 1071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.910176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49604 (local address 127.12.112.193:37553)
0807 22:51:36.910766 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:36.910782 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:36.910806 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:51:36.910892 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:36.910896 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:36.911055 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:36.911223 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:36.911678 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.912444 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.914006 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.914723 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.915579 (+ 856us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.915706 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:36.915758 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 22:51:36.915849 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":129,"threads_started":1}
I20260807 22:51:36.916272 1068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.909588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:42063 (local address 127.0.0.1:53294)
0807 22:51:36.910469 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:36.910485 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:36.910573 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:36.911394 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:36.911397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:36.911412 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:36.911565 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.911571 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.913064 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.913067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.914183 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.914194 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.915797 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.915800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.915905 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.915927 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:51:36.916008 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 22:51:36.916083 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":20,"thread_start_us":85,"threads_started":1}
I20260807 22:51:36.916616 1073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.910534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53294 (local address 127.12.112.195:42063)
0807 22:51:36.910943 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:36.910957 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:36.910980 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:51:36.911059 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:36.911070 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:36.911247 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:36.911390 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:36.911688 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.912894 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.914294 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.915125 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.915251 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.915378 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:36.916055 (+ 677us) server_negotiation.cc:299] Negotiation successful
0807 22:51:36.916254 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":104,"threads_started":1}
I20260807 22:51:36.917013 1069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.909534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53848 (local address 127.12.112.194:39517)
0807 22:51:36.910279 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:36.910291 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:36.910347 (+ 56us) server_negotiation.cc:407] Connection header received
0807 22:51:36.910796 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:36.910813 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:36.911078 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:36.911632 (+ 554us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:36.911784 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.912873 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.914226 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.915125 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.915251 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.915378 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:36.915596 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 22:51:36.915863 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":134,"threads_started":1}
I20260807 22:51:36.919142 988 tablet_service.cc:1467] Processing CreateTablet for tablet 00934f011c0841d3b9800891bcb46b31 (DEFAULT_TABLE table=test-table [id=746e194bab2b42e2ba1b3b8769f8a069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:36.919165 703 tablet_service.cc:1467] Processing CreateTablet for tablet 00934f011c0841d3b9800891bcb46b31 (DEFAULT_TABLE table=test-table [id=746e194bab2b42e2ba1b3b8769f8a069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:36.919538 843 tablet_service.cc:1467] Processing CreateTablet for tablet 00934f011c0841d3b9800891bcb46b31 (DEFAULT_TABLE table=test-table [id=746e194bab2b42e2ba1b3b8769f8a069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:36.920156 988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00934f011c0841d3b9800891bcb46b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:36.920187 703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00934f011c0841d3b9800891bcb46b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:36.920399 843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00934f011c0841d3b9800891bcb46b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:36.926555 1074 tablet_bootstrap.cc:492] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: Bootstrap starting.
I20260807 22:51:36.927860 1075 tablet_bootstrap.cc:492] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: Bootstrap starting.
I20260807 22:51:36.928807 1074 tablet_bootstrap.cc:654] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:36.929039 1077 tablet_bootstrap.cc:492] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed: Bootstrap starting.
I20260807 22:51:36.929626 1075 tablet_bootstrap.cc:654] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:36.930187 1074 log.cc:824] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:36.930787 1075 log.cc:824] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:36.931061 1077 tablet_bootstrap.cc:654] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:36.932235 1077 log.cc:824] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:36.932346 1074 tablet_bootstrap.cc:492] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: No bootstrap required, opened a new log
I20260807 22:51:36.932528 1074 ts_tablet_manager.cc:1397] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:51:36.932608 1075 tablet_bootstrap.cc:492] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: No bootstrap required, opened a new log
I20260807 22:51:36.932771 1075 ts_tablet_manager.cc:1397] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:51:36.933971 1077 tablet_bootstrap.cc:492] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed: No bootstrap required, opened a new log
I20260807 22:51:36.934156 1077 ts_tablet_manager.cc:1397] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:51:36.936508 1074 raft_consensus.cc:348] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 } } peers { permanent_uuid: "61d65664472c4cc69a1edc00eda895b5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42063 } } peers { permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 } }
I20260807 22:51:36.936508 1075 raft_consensus.cc:348] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 } } peers { permanent_uuid: "61d65664472c4cc69a1edc00eda895b5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42063 } } peers { permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 } }
I20260807 22:51:36.936774 1074 raft_consensus.cc:374] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:36.936774 1075 raft_consensus.cc:374] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:36.936838 1075 raft_consensus.cc:729] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 915395f7e180490ba176ca11fc087820, State: Initialized, Role: FOLLOWER
I20260807 22:51:36.936838 1074 raft_consensus.cc:729] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61d65664472c4cc69a1edc00eda895b5, State: Initialized, Role: FOLLOWER
I20260807 22:51:36.936874 1077 raft_consensus.cc:348] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 } } peers { permanent_uuid: "61d65664472c4cc69a1edc00eda895b5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42063 } } peers { permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 } }
I20260807 22:51:36.937130 1077 raft_consensus.cc:374] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:36.937191 1077 raft_consensus.cc:729] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6961e753eb14ba39b56bf59b96fbfed, State: Initialized, Role: FOLLOWER
I20260807 22:51:36.937291 1075 consensus_queue.cc:260] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 } } peers { permanent_uuid: "61d65664472c4cc69a1edc00eda895b5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42063 } } peers { permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 } }
I20260807 22:51:36.937299 1074 consensus_queue.cc:260] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 } } peers { permanent_uuid: "61d65664472c4cc69a1edc00eda895b5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42063 } } peers { permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 } }
I20260807 22:51:36.937623 1077 consensus_queue.cc:260] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 } } peers { permanent_uuid: "61d65664472c4cc69a1edc00eda895b5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42063 } } peers { permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 } }
I20260807 22:51:36.938184 912 heartbeater.cc:503] Master 127.12.112.254:38411 was elected leader, sending a full tablet report...
I20260807 22:51:36.938273 1074 ts_tablet_manager.cc:1428] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:51:36.938280 1055 heartbeater.cc:503] Master 127.12.112.254:38411 was elected leader, sending a full tablet report...
I20260807 22:51:36.938449 1075 ts_tablet_manager.cc:1428] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:51:36.938870 773 heartbeater.cc:503] Master 127.12.112.254:38411 was elected leader, sending a full tablet report...
I20260807 22:51:36.940135 1077 ts_tablet_manager.cc:1428] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
I20260807 22:51:36.979969 1081 raft_consensus.cc:482] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:36.980194 1081 raft_consensus.cc:504] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 } } peers { permanent_uuid: "61d65664472c4cc69a1edc00eda895b5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42063 } } peers { permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 } }
I20260807 22:51:36.981472 1081 leader_election.cc:288] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 915395f7e180490ba176ca11fc087820 (127.12.112.194:39517), b6961e753eb14ba39b56bf59b96fbfed (127.12.112.193:37553)
I20260807 22:51:36.986327 1057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.981662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:39517 (local address 127.12.112.195:40955)
0807 22:51:36.981813 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:36.981831 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:36.981927 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:36.982219 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:36.982222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:36.982246 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:36.982420 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.982431 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.983435 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.983437 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.984770 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.984781 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.985692 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.985696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.985914 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.985972 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 22:51:36.986056 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 22:51:36.986139 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":143}
I20260807 22:51:36.986370 1071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.982042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:33839 (local address 127.12.112.193:37553)
0807 22:51:36.982202 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:36.982206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:36.982351 (+ 145us) server_negotiation.cc:407] Connection header received
0807 22:51:36.982450 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:36.982456 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:36.982527 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:36.982608 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:36.982844 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.983543 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.984983 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.985577 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.985682 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.985721 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:36.986140 (+ 419us) server_negotiation.cc:299] Negotiation successful
0807 22:51:36.986227 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:51:36.986485 1069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.981755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:40955 (local address 127.12.112.194:39517)
0807 22:51:36.981947 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:36.981954 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:36.981976 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:51:36.982034 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:36.982037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:36.982098 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:36.982189 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:36.982528 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.983335 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.984900 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.985532 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.985668 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.985721 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:36.986245 (+ 524us) server_negotiation.cc:299] Negotiation successful
0807 22:51:36.986349 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 22:51:36.986340 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:36.981727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:37553 (local address 127.12.112.195:33839)
0807 22:51:36.982221 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:36.982233 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:36.982338 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:36.982625 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:36.982627 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:36.982643 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:36.982739 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.982760 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.983634 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.983637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.984868 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:36.984876 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:36.985692 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:36.985696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:36.985919 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:36.986054 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 22:51:36.986119 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 22:51:36.986168 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":162,"thread_start_us":197,"threads_started":1}
I20260807 22:51:36.987159 864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00934f011c0841d3b9800891bcb46b31" candidate_uuid: "61d65664472c4cc69a1edc00eda895b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "915395f7e180490ba176ca11fc087820" is_pre_election: true
I20260807 22:51:36.987435 723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00934f011c0841d3b9800891bcb46b31" candidate_uuid: "61d65664472c4cc69a1edc00eda895b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6961e753eb14ba39b56bf59b96fbfed" is_pre_election: true
I20260807 22:51:36.987500 864 raft_consensus.cc:2454] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61d65664472c4cc69a1edc00eda895b5 in term 0.
I20260807 22:51:36.987717 723 raft_consensus.cc:2454] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61d65664472c4cc69a1edc00eda895b5 in term 0.
I20260807 22:51:36.988104 937 leader_election.cc:302] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61d65664472c4cc69a1edc00eda895b5, 915395f7e180490ba176ca11fc087820; no voters:
I20260807 22:51:36.988412 1081 raft_consensus.cc:2781] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:51:36.988497 1081 raft_consensus.cc:482] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:51:36.988540 1081 raft_consensus.cc:3037] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:36.989580 1081 raft_consensus.cc:504] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 } } peers { permanent_uuid: "61d65664472c4cc69a1edc00eda895b5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42063 } } peers { permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 } }
I20260807 22:51:36.989919 1081 leader_election.cc:288] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [CANDIDATE]: Term 1 election: Requested vote from peers 915395f7e180490ba176ca11fc087820 (127.12.112.194:39517), b6961e753eb14ba39b56bf59b96fbfed (127.12.112.193:37553)
I20260807 22:51:36.990276 864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00934f011c0841d3b9800891bcb46b31" candidate_uuid: "61d65664472c4cc69a1edc00eda895b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "915395f7e180490ba176ca11fc087820"
I20260807 22:51:36.990346 723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00934f011c0841d3b9800891bcb46b31" candidate_uuid: "61d65664472c4cc69a1edc00eda895b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6961e753eb14ba39b56bf59b96fbfed"
I20260807 22:51:36.990447 864 raft_consensus.cc:3037] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:36.990482 723 raft_consensus.cc:3037] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:36.991469 864 raft_consensus.cc:2454] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61d65664472c4cc69a1edc00eda895b5 in term 1.
I20260807 22:51:36.991564 723 raft_consensus.cc:2454] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61d65664472c4cc69a1edc00eda895b5 in term 1.
I20260807 22:51:36.991788 937 leader_election.cc:302] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61d65664472c4cc69a1edc00eda895b5, 915395f7e180490ba176ca11fc087820; no voters:
I20260807 22:51:36.991953 1081 raft_consensus.cc:2781] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:36.992138 1081 raft_consensus.cc:686] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 1 LEADER]: Becoming Leader. State: Replica: 61d65664472c4cc69a1edc00eda895b5, State: Running, Role: LEADER
I20260807 22:51:36.992449 1081 consensus_queue.cc:237] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 } } peers { permanent_uuid: "61d65664472c4cc69a1edc00eda895b5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42063 } } peers { permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 } }
I20260807 22:51:36.995548 572 catalog_manager.cc:5495] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61d65664472c4cc69a1edc00eda895b5 (127.12.112.195). New cstate: current_term: 1 leader_uuid: "61d65664472c4cc69a1edc00eda895b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61d65664472c4cc69a1edc00eda895b5" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 } health_report { overall_health: UNKNOWN } } }
I20260807 22:51:37.015431 1073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.011457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53308 (local address 127.12.112.195:42063)
0807 22:51:37.011591 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:37.011594 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:37.011607 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:51:37.011814 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:37.011819 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:37.011900 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:37.012036 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:51:37.012356 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.013073 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.014117 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.014396 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.014492 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.014742 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:51:37.015114 (+ 372us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:51:37.015204 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:37.015260 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 22:51:37.015327 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:51:37.020967 723 raft_consensus.cc:1261] T 00934f011c0841d3b9800891bcb46b31 P b6961e753eb14ba39b56bf59b96fbfed [term 1 FOLLOWER]: Refusing update from remote peer 61d65664472c4cc69a1edc00eda895b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:37.020965 864 raft_consensus.cc:1261] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820 [term 1 FOLLOWER]: Refusing update from remote peer 61d65664472c4cc69a1edc00eda895b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:37.021669 1086 consensus_queue.cc:1035] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "915395f7e180490ba176ca11fc087820" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 39517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:37.021842 1081 consensus_queue.cc:1035] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6961e753eb14ba39b56bf59b96fbfed" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 37553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:37.029716 1090 mvcc.cc:205] Tried to move back new op lower bound from 7316042125390761984 to 7316042125283766272. Current Snapshot: MvccSnapshot[applied={T|T < 7316042125390761984}]
I20260807 22:51:37.030630 1091 mvcc.cc:205] Tried to move back new op lower bound from 7316042125390761984 to 7316042125283766272. Current Snapshot: MvccSnapshot[applied={T|T < 7316042125390761984}]
I20260807 22:51:37.037775 571 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:37.037974 571 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:37.040537 571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2aede3d105ef4ecda13ffd0b2f3982a2: Sending DeleteTablet for 3 replicas of tablet 00934f011c0841d3b9800891bcb46b31
I20260807 22:51:37.041395 988 tablet_service.cc:1514] Processing DeleteTablet for tablet 00934f011c0841d3b9800891bcb46b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:37 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:53294
I20260807 22:51:37.041415 703 tablet_service.cc:1514] Processing DeleteTablet for tablet 00934f011c0841d3b9800891bcb46b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:37 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:49604
I20260807 22:51:37.041404 843 tablet_service.cc:1514] Processing DeleteTablet for tablet 00934f011c0841d3b9800891bcb46b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:37 UTC) from {username='kudu', principal='kudu/127.12.112.254@KRBTEST.COM'} at 127.0.0.1:53848
I20260807 22:51:37.042044 1101 tablet_replica.cc:330] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: stopping tablet replica
I20260807 22:51:37.042404 1101 raft_consensus.cc:2229] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:51:37.042446 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 637
I20260807 22:51:37.046592 1101 raft_consensus.cc:2258] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:37.047021 1099 tablet_replica.cc:330] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: stopping tablet replica
I20260807 22:51:37.047313 1099 raft_consensus.cc:2229] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:51:37.047710 1099 raft_consensus.cc:2258] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:37.049283 1101 ts_tablet_manager.cc:1905] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:37.051445 1099 ts_tablet_manager.cc:1905] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:37.052132 1101 ts_tablet_manager.cc:1918] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:37.052237 1101 log.cc:1196] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/00934f011c0841d3b9800891bcb46b31
W20260807 22:51:37.052345 558 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:37553 (error 108)
I20260807 22:51:37.052590 1101 ts_tablet_manager.cc:1939] T 00934f011c0841d3b9800891bcb46b31 P 915395f7e180490ba176ca11fc087820: Deleting consensus metadata
I20260807 22:51:37.053787 556 catalog_manager.cc:4841] TS 915395f7e180490ba176ca11fc087820 (127.12.112.194:39517): tablet 00934f011c0841d3b9800891bcb46b31 (table test-table [id=746e194bab2b42e2ba1b3b8769f8a069]) successfully deleted
I20260807 22:51:37.053807 1068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.053500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:37553 (local address 127.0.0.1:49608)
0807 22:51:37.053621 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:37.053695 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 22:51:37.054106 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 778
W20260807 22:51:37.054106 558 catalog_manager.cc:4584] TS b6961e753eb14ba39b56bf59b96fbfed (127.12.112.193:37553): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 00934f011c0841d3b9800891bcb46b31: Network error: Client connection negotiation failed: client connection to 127.12.112.193:37553: connect: Connection refused (error 111)
I20260807 22:51:37.056696 1099 ts_tablet_manager.cc:1918] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:37.056820 1099 log.cc:1196] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/00934f011c0841d3b9800891bcb46b31
I20260807 22:51:37.057174 1099 ts_tablet_manager.cc:1939] T 00934f011c0841d3b9800891bcb46b31 P 61d65664472c4cc69a1edc00eda895b5: Deleting consensus metadata
I20260807 22:51:37.058387 558 catalog_manager.cc:4841] TS 61d65664472c4cc69a1edc00eda895b5 (127.12.112.195:42063): tablet 00934f011c0841d3b9800891bcb46b31 (table test-table [id=746e194bab2b42e2ba1b3b8769f8a069]) successfully deleted
I20260807 22:51:37.063222 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 918
I20260807 22:51:37.070416 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 538
2026-08-07T22:51:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2277 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T22:51:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:37Z Disabled control of system clock
I20260807 22:51:37.103223 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:44227
--webserver_interface=127.12.112.254
--webserver_port=0
--builtin_ntp_servers=127.12.112.212:39577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:44227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:51:37.212262 1106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:37.212504 1106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:37.212539 1106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:37.216399 1106 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:37.216451 1106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:37.216467 1106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:37.216483 1106 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:37.216498 1106 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:37.221139 1106 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:39577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:44227
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:44227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:37.222083 1106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:37.223366 1106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:37.231418 1115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:37.231506 1113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:37.231634 1106 server_base.cc:1034] running on GCE node
W20260807 22:51:37.231443 1112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:37.232301 1106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:37.233321 1106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:37.234511 1106 hybrid_clock.cc:648] HybridClock initialized: now 1786143097234494 us; error 29 us; skew 500 ppm
I20260807 22:51:37.236219 1106 webserver.cc:460] Webserver started at http://127.12.112.254:39279/ using document root <none> and password file <none>
I20260807 22:51:37.236794 1106 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:37.236887 1106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:37.237116 1106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:37.239188 1106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "e18871d61f2049ed8324fe8759230757"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "4d622516d474caa9b6282ee06b3cc8ec"
server_key_iv: "b653423ee859edf1665b6ad6f942454b"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.239743 1106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "e18871d61f2049ed8324fe8759230757"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "4d622516d474caa9b6282ee06b3cc8ec"
server_key_iv: "b653423ee859edf1665b6ad6f942454b"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.243546 1106 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:51:37.245908 1121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:37.247082 1106 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:51:37.247221 1106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "e18871d61f2049ed8324fe8759230757"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "4d622516d474caa9b6282ee06b3cc8ec"
server_key_iv: "b653423ee859edf1665b6ad6f942454b"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.247329 1106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:37.271780 1106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:37.272483 1106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:37.272691 1106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:37.279481 1106 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:44227
I20260807 22:51:37.279515 1176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:44227 every 8 connection(s)
I20260807 22:51:37.280403 1106 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:37.283802 1178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:37.289011 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 1106
I20260807 22:51:37.289139 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:37.289461 12739 external_mini_cluster.cc:1428] Setting key 67480f3cfe5ee0839c0204ca4116e2c6
I20260807 22:51:37.289994 1178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757: Bootstrap starting.
I20260807 22:51:37.292315 1178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:37.293174 1178 log.cc:824] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:37.295401 1178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757: No bootstrap required, opened a new log
I20260807 22:51:37.298830 1181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.290867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34098 (local address 127.12.112.254:44227)
0807 22:51:37.291483 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:37.291497 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:37.291532 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:51:37.292142 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:37.292158 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:37.292589 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:37.292857 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:37.293194 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.294523 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.295661 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.296113 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.296225 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.297085 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:37.297089 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:37.297100 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:37.297467 (+ 367us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:37.297519 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:37.297537 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:37.297612 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:37.297774 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 22:51:37.298069 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":268,"thread_start_us":141,"threads_started":1}
I20260807 22:51:37.299424 1178 raft_consensus.cc:348] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18871d61f2049ed8324fe8759230757" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44227 } }
I20260807 22:51:37.299659 1178 raft_consensus.cc:374] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:37.299741 1178 raft_consensus.cc:729] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e18871d61f2049ed8324fe8759230757, State: Initialized, Role: FOLLOWER
I20260807 22:51:37.300190 1178 consensus_queue.cc:260] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18871d61f2049ed8324fe8759230757" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44227 } }
I20260807 22:51:37.300333 1178 raft_consensus.cc:388] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:37.300386 1178 raft_consensus.cc:482] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:37.300465 1178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:37.301450 1178 raft_consensus.cc:504] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18871d61f2049ed8324fe8759230757" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44227 } }
I20260807 22:51:37.301770 1178 leader_election.cc:302] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e18871d61f2049ed8324fe8759230757; no voters:
I20260807 22:51:37.302060 1178 leader_election.cc:288] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:37.302184 1183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:37.302443 1183 raft_consensus.cc:686] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [term 1 LEADER]: Becoming Leader. State: Replica: e18871d61f2049ed8324fe8759230757, State: Running, Role: LEADER
I20260807 22:51:37.302759 1183 consensus_queue.cc:237] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18871d61f2049ed8324fe8759230757" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44227 } }
I20260807 22:51:37.303247 1178 sys_catalog.cc:564] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:37.304414 1185 sys_catalog.cc:455] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e18871d61f2049ed8324fe8759230757. Latest consensus state: current_term: 1 leader_uuid: "e18871d61f2049ed8324fe8759230757" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18871d61f2049ed8324fe8759230757" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44227 } } }
I20260807 22:51:37.304422 1184 sys_catalog.cc:455] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e18871d61f2049ed8324fe8759230757" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18871d61f2049ed8324fe8759230757" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 44227 } } }
I20260807 22:51:37.304566 1185 sys_catalog.cc:458] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:37.304570 1184 sys_catalog.cc:458] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:37.304919 1192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:37.307879 1192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:37.312796 1192 catalog_manager.cc:1347] Generated new cluster ID: 97f04a79432d46ceb2f312344f63b364
I20260807 22:51:37.312856 1192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:37.325282 1192 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:37.326435 1192 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:37.334522 1192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757: Generated new TSK 0
I20260807 22:51:37.335224 1192 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:37.340265 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.193:0
--local_ip_for_outbound_sockets=127.12.112.193
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44227
--builtin_ntp_servers=127.12.112.212:39577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:51:37.450287 1202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:37.450583 1202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:37.450659 1202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:37.454666 1202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:37.454736 1202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:37.454826 1202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.193
I20260807 22:51:37.459431 1202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:39577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.112.193
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.193
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:37.460438 1202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:37.461776 1202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:37.471242 1208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:37.471203 1207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:37.471235 1202 server_base.cc:1034] running on GCE node
W20260807 22:51:37.471203 1210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:37.471832 1202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:37.472414 1202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:37.473568 1202 hybrid_clock.cc:648] HybridClock initialized: now 1786143097473549 us; error 31 us; skew 500 ppm
I20260807 22:51:37.475298 1202 webserver.cc:460] Webserver started at http://127.12.112.193:45321/ using document root <none> and password file <none>
I20260807 22:51:37.475795 1202 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:37.475852 1202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:37.476018 1202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:37.477963 1202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/data/instance:
uuid: "b2cb0932a7cc41a482207c116d74180f"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "3e1bc8beb099ff72072c3ab4f4970c79"
server_key_iv: "aaca3d8492ce8124f871ebb303b53536"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.478538 1202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance:
uuid: "b2cb0932a7cc41a482207c116d74180f"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "3e1bc8beb099ff72072c3ab4f4970c79"
server_key_iv: "aaca3d8492ce8124f871ebb303b53536"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.481902 1202 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:51:37.484164 1216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:37.485299 1202 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:51:37.485390 1202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/wal
uuid: "b2cb0932a7cc41a482207c116d74180f"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "3e1bc8beb099ff72072c3ab4f4970c79"
server_key_iv: "aaca3d8492ce8124f871ebb303b53536"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.485471 1202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:37.505273 1202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:37.505837 1202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:37.505987 1202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:37.506495 1202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:37.507391 1202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:37.507438 1202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:37.507478 1202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:37.507494 1202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:37.516152 1202 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.193:33333
I20260807 22:51:37.516198 1339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.193:33333 every 8 connection(s)
I20260807 22:51:37.517102 1202 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/data/info.pb
I20260807 22:51:37.525993 1181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.518920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:49357 (local address 127.12.112.254:44227)
0807 22:51:37.519065 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:37.519068 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:37.520005 (+ 937us) server_negotiation.cc:407] Connection header received
0807 22:51:37.521371 (+ 1366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:37.521375 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:37.521435 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:37.521545 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:37.522427 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.522994 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.524125 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.524362 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.524474 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.525489 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:37.525493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:37.525497 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:37.525515 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:37.525533 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:37.525540 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:37.525617 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:37.525780 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 22:51:37.525848 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:51:37.526827 1342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.519259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:44227 (local address 127.12.112.193:49357)
0807 22:51:37.519854 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:37.519892 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:37.521154 (+ 1262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:37.521711 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:37.521717 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:37.521795 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:37.522236 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.522247 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.523136 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.523140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.523999 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.524009 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.524512 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.524517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.524681 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.525227 (+ 546us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:51:37.525228 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:37.525274 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:51:37.525330 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:37.525631 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:37.525644 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:37.525654 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 22:51:37.525765 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:51:37.526013 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":111,"threads_started":1}
I20260807 22:51:37.527154 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 1202
I20260807 22:51:37.527280 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-0/wal/instance
I20260807 22:51:37.527632 12739 external_mini_cluster.cc:1428] Setting key 1431e2949ab3d5582d06109edebd2653
I20260807 22:51:37.528136 1340 heartbeater.cc:347] Connected to a master server at 127.12.112.254:44227
I20260807 22:51:37.528373 1340 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:37.528885 1340 heartbeater.cc:511] Master 127.12.112.254:44227 requested a full tablet report, sending...
I20260807 22:51:37.529700 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.194:0
--local_ip_for_outbound_sockets=127.12.112.194
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44227
--builtin_ntp_servers=127.12.112.212:39577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:51:37.530464 1140 ts_manager.cc:194] Registered new tserver with Master: b2cb0932a7cc41a482207c116d74180f (127.12.112.193:33333)
I20260807 22:51:37.531826 1140 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.193:49357
W20260807 22:51:37.640781 1343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:37.641021 1343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:37.641057 1343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:37.644865 1343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:37.644905 1343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:37.644956 1343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.194
I20260807 22:51:37.649487 1343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:39577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.112.194
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.194
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:37.650431 1343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:37.651706 1343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:51:37.661188 1343 server_base.cc:1034] running on GCE node
W20260807 22:51:37.661204 1349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:37.661134 1350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:37.661154 1352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:37.661804 1343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:37.662464 1343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:37.663643 1343 hybrid_clock.cc:648] HybridClock initialized: now 1786143097663625 us; error 28 us; skew 500 ppm
I20260807 22:51:37.665356 1343 webserver.cc:460] Webserver started at http://127.12.112.194:44585/ using document root <none> and password file <none>
I20260807 22:51:37.665917 1343 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:37.666010 1343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:37.666210 1343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:37.668216 1343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/data/instance:
uuid: "0b6b65b78f3642f4aa8f85a9fc493697"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "de0855fff90025ce23bc45b371b5d85f"
server_key_iv: "947c56869080f1085e3d46298b840dd6"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.668783 1343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance:
uuid: "0b6b65b78f3642f4aa8f85a9fc493697"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "de0855fff90025ce23bc45b371b5d85f"
server_key_iv: "947c56869080f1085e3d46298b840dd6"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.672269 1343 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:51:37.674597 1359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:37.675747 1343 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:51:37.675876 1343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/wal
uuid: "0b6b65b78f3642f4aa8f85a9fc493697"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "de0855fff90025ce23bc45b371b5d85f"
server_key_iv: "947c56869080f1085e3d46298b840dd6"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.675981 1343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:37.696472 1343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:37.697110 1343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:37.697309 1343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:37.697876 1343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:37.698803 1343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:37.698873 1343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:37.698943 1343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:37.698987 1343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:37.708019 1343 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.194:35257
I20260807 22:51:37.708056 1480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.194:35257 every 8 connection(s)
I20260807 22:51:37.708868 1343 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/data/info.pb
I20260807 22:51:37.716086 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 1343
I20260807 22:51:37.716209 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/wal/instance
I20260807 22:51:37.716542 12739 external_mini_cluster.cc:1428] Setting key f4227fd5d32a0fe409966f995b9ff275
I20260807 22:51:37.717621 1181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.710611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.194:45449 (local address 127.12.112.254:44227)
0807 22:51:37.710782 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:37.710786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:37.711752 (+ 966us) server_negotiation.cc:407] Connection header received
0807 22:51:37.713071 (+ 1319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:37.713074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:37.713120 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:37.713194 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:37.714002 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.714599 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.715655 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.715867 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.715971 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.717125 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:37.717128 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:37.717131 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:37.717143 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:37.717168 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:37.717177 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:37.717251 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:37.717420 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 22:51:37.717478 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 22:51:37.718410 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.710991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:44227 (local address 127.12.112.194:45449)
0807 22:51:37.711601 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:37.711640 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:37.712894 (+ 1254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:37.713345 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:37.713350 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:37.713428 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:37.713883 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.713895 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.714705 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.714707 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.715551 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.715559 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.716020 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.716025 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.716232 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.716878 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:51:37.716879 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:37.716916 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:51:37.716973 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:37.717263 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:37.717275 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:37.717283 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:51:37.717416 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 22:51:37.717663 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":121,"threads_started":1}
I20260807 22:51:37.718609 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.112.195:0
--local_ip_for_outbound_sockets=127.12.112.195
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44227
--builtin_ntp_servers=127.12.112.212:39577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:51:37.719501 1481 heartbeater.cc:347] Connected to a master server at 127.12.112.254:44227
I20260807 22:51:37.719724 1481 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:37.720288 1481 heartbeater.cc:511] Master 127.12.112.254:44227 requested a full tablet report, sending...
I20260807 22:51:37.721354 1140 ts_manager.cc:194] Registered new tserver with Master: 0b6b65b78f3642f4aa8f85a9fc493697 (127.12.112.194:35257)
I20260807 22:51:37.722002 1140 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.194:45449
W20260807 22:51:37.832744 1484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:37.832998 1484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:37.833065 1484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:37.837082 1484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:37.837153 1484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:37.837235 1484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.112.195
I20260807 22:51:37.841859 1484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:39577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.112.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.112.195
--webserver_port=0
--tserver_master_addrs=127.12.112.254:44227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.112.195
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:37.842901 1484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:37.844209 1484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:37.853684 1489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:37.853724 1484 server_base.cc:1034] running on GCE node
W20260807 22:51:37.853690 1492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:37.853701 1490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:37.854254 1484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:37.854919 1484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:37.856114 1484 hybrid_clock.cc:648] HybridClock initialized: now 1786143097856087 us; error 44 us; skew 500 ppm
I20260807 22:51:37.857923 1484 webserver.cc:460] Webserver started at http://127.12.112.195:41373/ using document root <none> and password file <none>
I20260807 22:51:37.858548 1484 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:37.858613 1484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:37.858817 1484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:37.860760 1484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/data/instance:
uuid: "a19547abe0a14a98bf55f72baa8cc105"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "1221448e12f01a8a39dd6fe3414366e7"
server_key_iv: "f5b50ba384085f80ac72c02fdaf107e6"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.861289 1484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance:
uuid: "a19547abe0a14a98bf55f72baa8cc105"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "1221448e12f01a8a39dd6fe3414366e7"
server_key_iv: "f5b50ba384085f80ac72c02fdaf107e6"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.864812 1484 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:51:37.867178 1499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:37.868396 1484 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:37.868520 1484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/wal
uuid: "a19547abe0a14a98bf55f72baa8cc105"
format_stamp: "Formatted at 2026-08-07 22:51:37 on dist-test-slave-tm1g"
server_key: "1221448e12f01a8a39dd6fe3414366e7"
server_key_iv: "f5b50ba384085f80ac72c02fdaf107e6"
server_key_version: "encryptionkey@0"
I20260807 22:51:37.868616 1484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:37.882498 1484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:37.883088 1484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:37.883273 1484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:37.883821 1484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:51:37.884693 1484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:51:37.884738 1484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:37.884805 1484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:51:37.884845 1484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:37.893657 1484 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.195:32771
I20260807 22:51:37.893687 1621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.195:32771 every 8 connection(s)
I20260807 22:51:37.894623 1484 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/data/info.pb
I20260807 22:51:37.895799 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 1484
I20260807 22:51:37.895917 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/wal/instance
I20260807 22:51:37.896245 12739 external_mini_cluster.cc:1428] Setting key 380b6ea438da30a013f745c96b694ccd
I20260807 22:51:37.903911 1181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.896492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.195:36871 (local address 127.12.112.254:44227)
0807 22:51:37.896812 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:37.896817 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:37.897854 (+ 1037us) server_negotiation.cc:407] Connection header received
0807 22:51:37.899337 (+ 1483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:37.899341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:37.899396 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:37.899492 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:37.900333 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.900874 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.902005 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.902230 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.902376 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.903411 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:37.903414 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:37.903417 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:37.903430 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:37.903455 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:37.903463 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:37.903538 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:37.903690 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 22:51:37.903751 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233}
I20260807 22:51:37.904676 1624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.896925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:44227 (local address 127.12.112.195:36871)
0807 22:51:37.897710 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:37.897751 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:37.899132 (+ 1381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:37.899653 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:37.899659 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:37.899735 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:51:37.900184 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.900196 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.900997 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.901001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.901873 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.901883 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.902404 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.902409 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.902570 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.903166 (+ 596us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:51:37.903168 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:51:37.903205 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:51:37.903263 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:51:37.903539 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:51:37.903550 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:51:37.903558 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:51:37.903690 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 22:51:37.903978 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":159,"threads_started":1}
I20260807 22:51:37.905754 1622 heartbeater.cc:347] Connected to a master server at 127.12.112.254:44227
I20260807 22:51:37.905936 1622 heartbeater.cc:464] Registering TS with master...
I20260807 22:51:37.906453 1622 heartbeater.cc:511] Master 127.12.112.254:44227 requested a full tablet report, sending...
I20260807 22:51:37.907372 1140 ts_manager.cc:194] Registered new tserver with Master: a19547abe0a14a98bf55f72baa8cc105 (127.12.112.195:32771)
I20260807 22:51:37.907891 1140 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.112.195:36871
I20260807 22:51:37.910038 12739 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:51:37.915217 1181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.911995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34108 (local address 127.12.112.254:44227)
0807 22:51:37.912105 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:37.912108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:37.912296 (+ 188us) server_negotiation.cc:407] Connection header received
0807 22:51:37.912380 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:37.912381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:37.912415 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:37.912485 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:37.912716 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.913184 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.913939 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.914133 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.914202 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.914918 (+ 716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:37.914920 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:37.914923 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:37.914933 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:37.914950 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:37.914957 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:37.915016 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:37.915084 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 22:51:37.915125 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:51:37.917843 1140 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:51:37.920806 1140 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:51:37.934168 1633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.928609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:35257 (local address 127.0.0.1:58952)
0807 22:51:37.928980 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:37.929030 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:37.929158 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:37.929964 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:37.929969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:37.929991 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:37.930117 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.930123 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.931406 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.931409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.932558 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.932568 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.933621 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.933625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.933728 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.933769 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 22:51:37.933884 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 22:51:37.934027 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":1,"thread_start_us":65,"threads_started":1}
I20260807 22:51:37.934213 1635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.928771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58952 (local address 127.12.112.194:35257)
0807 22:51:37.929465 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:37.929489 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:37.929515 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:51:37.929592 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:37.929597 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:37.929795 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:37.929970 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:37.930252 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.931296 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.932697 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.933492 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.933610 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.933775 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:37.933930 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 22:51:37.934037 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":155,"threads_started":1}
I20260807 22:51:37.934690 1636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.929296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:32771 (local address 127.0.0.1:40260)
0807 22:51:37.929594 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:37.929607 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:37.929698 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:37.930747 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:37.930750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:37.930768 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:37.930844 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.930849 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.932124 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.932128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.933146 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.933157 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.934246 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.934252 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.934364 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.934404 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 22:51:37.934483 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 22:51:37.934564 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":25,"thread_start_us":102,"threads_started":1}
I20260807 22:51:37.934933 1634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.928639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:33333 (local address 127.0.0.1:54956)
0807 22:51:37.929202 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:37.929217 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:37.929295 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:37.930399 (+ 1104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:37.930403 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:37.930420 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:37.930508 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.930513 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.931934 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.931937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.933070 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:37.933079 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.934364 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.934367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:37.934459 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.934483 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:51:37.934556 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 22:51:37.934621 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":25,"thread_start_us":81,"threads_started":1}
I20260807 22:51:37.934998 1637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.929374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54956 (local address 127.12.112.193:33333)
0807 22:51:37.929787 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:37.929798 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:37.929825 (+ 27us) server_negotiation.cc:407] Connection header received
0807 22:51:37.929887 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:37.929917 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:37.930087 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:37.930234 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:37.930636 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.931813 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.933201 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.934006 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.934118 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.934271 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:37.934612 (+ 341us) server_negotiation.cc:299] Negotiation successful
0807 22:51:37.934712 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":112,"threads_started":1}
I20260807 22:51:37.935110 1639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:37.929587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40260 (local address 127.12.112.195:32771)
0807 22:51:37.930280 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:37.930293 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:37.930338 (+ 45us) server_negotiation.cc:407] Connection header received
0807 22:51:37.930409 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:37.930415 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:37.930604 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:37.930754 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:37.930955 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.932017 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.933265 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:37.933925 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:37.934031 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:37.934178 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:37.934861 (+ 683us) server_negotiation.cc:299] Negotiation successful
0807 22:51:37.934956 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":117,"threads_started":1}
I20260807 22:51:37.937463 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 226c1d2b581f41e4abc3f9f525114964 (DEFAULT_TABLE table=test-table [id=122e54719f534c1897d9be8242bd375d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:37.937667 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 226c1d2b581f41e4abc3f9f525114964 (DEFAULT_TABLE table=test-table [id=122e54719f534c1897d9be8242bd375d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:37.938485 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 226c1d2b581f41e4abc3f9f525114964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:37.938638 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 226c1d2b581f41e4abc3f9f525114964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:37.940121 1548 tablet_service.cc:1467] Processing CreateTablet for tablet 226c1d2b581f41e4abc3f9f525114964 (DEFAULT_TABLE table=test-table [id=122e54719f534c1897d9be8242bd375d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:51:37.941020 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 226c1d2b581f41e4abc3f9f525114964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:37.945137 1640 tablet_bootstrap.cc:492] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: Bootstrap starting.
I20260807 22:51:37.945716 1642 tablet_bootstrap.cc:492] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f: Bootstrap starting.
I20260807 22:51:37.947597 1643 tablet_bootstrap.cc:492] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: Bootstrap starting.
I20260807 22:51:37.947685 1640 tablet_bootstrap.cc:654] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:37.947685 1642 tablet_bootstrap.cc:654] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:37.948554 1640 log.cc:824] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:37.948555 1642 log.cc:824] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:37.949548 1643 tablet_bootstrap.cc:654] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:37.950433 1643 log.cc:824] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:37.951026 1642 tablet_bootstrap.cc:492] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f: No bootstrap required, opened a new log
I20260807 22:51:37.951141 1640 tablet_bootstrap.cc:492] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: No bootstrap required, opened a new log
I20260807 22:51:37.951246 1642 ts_tablet_manager.cc:1397] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:51:37.951364 1640 ts_tablet_manager.cc:1397] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:51:37.952510 1643 tablet_bootstrap.cc:492] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: No bootstrap required, opened a new log
I20260807 22:51:37.952683 1643 ts_tablet_manager.cc:1397] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 22:51:37.954252 1640 raft_consensus.cc:348] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 } } peers { permanent_uuid: "b2cb0932a7cc41a482207c116d74180f" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33333 } } peers { permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 } }
I20260807 22:51:37.954561 1640 raft_consensus.cc:374] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:37.954617 1640 raft_consensus.cc:729] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b6b65b78f3642f4aa8f85a9fc493697, State: Initialized, Role: FOLLOWER
I20260807 22:51:37.955044 1640 consensus_queue.cc:260] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 } } peers { permanent_uuid: "b2cb0932a7cc41a482207c116d74180f" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33333 } } peers { permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 } }
I20260807 22:51:37.955433 1642 raft_consensus.cc:348] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 } } peers { permanent_uuid: "b2cb0932a7cc41a482207c116d74180f" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33333 } } peers { permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 } }
I20260807 22:51:37.955653 1481 heartbeater.cc:503] Master 127.12.112.254:44227 was elected leader, sending a full tablet report...
I20260807 22:51:37.955673 1642 raft_consensus.cc:374] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:37.955729 1642 raft_consensus.cc:729] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cb0932a7cc41a482207c116d74180f, State: Initialized, Role: FOLLOWER
I20260807 22:51:37.955989 1640 ts_tablet_manager.cc:1428] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:51:37.956107 1642 consensus_queue.cc:260] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 } } peers { permanent_uuid: "b2cb0932a7cc41a482207c116d74180f" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33333 } } peers { permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 } }
I20260807 22:51:37.956710 1340 heartbeater.cc:503] Master 127.12.112.254:44227 was elected leader, sending a full tablet report...
I20260807 22:51:37.956983 1642 ts_tablet_manager.cc:1428] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:51:37.958101 1643 raft_consensus.cc:348] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 } } peers { permanent_uuid: "b2cb0932a7cc41a482207c116d74180f" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33333 } } peers { permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 } }
I20260807 22:51:37.958350 1643 raft_consensus.cc:374] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:37.958413 1643 raft_consensus.cc:729] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a19547abe0a14a98bf55f72baa8cc105, State: Initialized, Role: FOLLOWER
I20260807 22:51:37.958809 1643 consensus_queue.cc:260] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 } } peers { permanent_uuid: "b2cb0932a7cc41a482207c116d74180f" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33333 } } peers { permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 } }
I20260807 22:51:37.959426 1622 heartbeater.cc:503] Master 127.12.112.254:44227 was elected leader, sending a full tablet report...
W20260807 22:51:37.959753 1482 tablet.cc:2369] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:51:37.960670 1643 ts_tablet_manager.cc:1428] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
W20260807 22:51:38.018231 1341 tablet.cc:2369] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:51:38.043285 1648 raft_consensus.cc:482] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:51:38.043545 1648 raft_consensus.cc:504] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 } } peers { permanent_uuid: "b2cb0932a7cc41a482207c116d74180f" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33333 } } peers { permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 } }
I20260807 22:51:38.044636 1648 leader_election.cc:288] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b6b65b78f3642f4aa8f85a9fc493697 (127.12.112.194:35257), a19547abe0a14a98bf55f72baa8cc105 (127.12.112.195:32771)
I20260807 22:51:38.048815 1635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:38.045017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:52909 (local address 127.12.112.194:35257)
0807 22:51:38.045153 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:38.045157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:38.045385 (+ 228us) server_negotiation.cc:407] Connection header received
0807 22:51:38.045453 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:38.045459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:38.045521 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:38.045631 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:38.045920 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:38.046555 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:38.047872 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:38.048269 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:38.048395 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:38.048446 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:38.048630 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 22:51:38.048696 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:51:38.048836 1650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:38.044900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.194:35257 (local address 127.12.112.193:52909)
0807 22:51:38.045162 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:38.045179 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:38.045307 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:38.045648 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:38.045652 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:38.045672 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:38.045799 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:38.045805 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:38.046662 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:38.046669 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:38.047743 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:38.047752 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:38.048388 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:38.048392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:38.048496 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:38.048518 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:51:38.048613 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 22:51:38.048683 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":4,"thread_start_us":97,"threads_started":1}
I20260807 22:51:38.048990 1639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:38.045432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.112.193:40659 (local address 127.12.112.195:32771)
0807 22:51:38.045605 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:38.045612 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:38.045629 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:51:38.045775 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:38.045779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:38.045834 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:38.045919 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:51:38.046189 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:38.046813 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:38.048022 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:38.048430 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:38.048561 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:38.048608 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:38.048806 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 22:51:38.048876 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 22:51:38.049010 1651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:38.045302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.195:32771 (local address 127.12.112.193:40659)
0807 22:51:38.045548 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:38.045561 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:51:38.045659 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:51:38.045934 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:51:38.045936 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:51:38.045953 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:51:38.046079 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:38.046084 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:38.046916 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:38.046922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:38.047899 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:51:38.047909 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:51:38.048568 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:51:38.048571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:51:38.048677 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:38.048694 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 22:51:38.048778 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 22:51:38.048857 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":19,"thread_start_us":65,"threads_started":1}
I20260807 22:51:38.049688 1570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "226c1d2b581f41e4abc3f9f525114964" candidate_uuid: "b2cb0932a7cc41a482207c116d74180f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a19547abe0a14a98bf55f72baa8cc105" is_pre_election: true
I20260807 22:51:38.049688 1430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "226c1d2b581f41e4abc3f9f525114964" candidate_uuid: "b2cb0932a7cc41a482207c116d74180f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" is_pre_election: true
I20260807 22:51:38.049991 1430 raft_consensus.cc:2454] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cb0932a7cc41a482207c116d74180f in term 0.
I20260807 22:51:38.049991 1570 raft_consensus.cc:2454] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cb0932a7cc41a482207c116d74180f in term 0.
I20260807 22:51:38.050518 1220 leader_election.cc:302] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a19547abe0a14a98bf55f72baa8cc105, b2cb0932a7cc41a482207c116d74180f; no voters:
I20260807 22:51:38.050801 1648 raft_consensus.cc:2781] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:51:38.050895 1648 raft_consensus.cc:482] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:51:38.050956 1648 raft_consensus.cc:3037] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:38.052028 1648 raft_consensus.cc:504] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 } } peers { permanent_uuid: "b2cb0932a7cc41a482207c116d74180f" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33333 } } peers { permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 } }
I20260807 22:51:38.052343 1648 leader_election.cc:288] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [CANDIDATE]: Term 1 election: Requested vote from peers 0b6b65b78f3642f4aa8f85a9fc493697 (127.12.112.194:35257), a19547abe0a14a98bf55f72baa8cc105 (127.12.112.195:32771)
I20260807 22:51:38.052811 1570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "226c1d2b581f41e4abc3f9f525114964" candidate_uuid: "b2cb0932a7cc41a482207c116d74180f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a19547abe0a14a98bf55f72baa8cc105"
I20260807 22:51:38.052800 1430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "226c1d2b581f41e4abc3f9f525114964" candidate_uuid: "b2cb0932a7cc41a482207c116d74180f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b6b65b78f3642f4aa8f85a9fc493697"
I20260807 22:51:38.052938 1570 raft_consensus.cc:3037] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:38.052938 1430 raft_consensus.cc:3037] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:38.054198 1570 raft_consensus.cc:2454] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cb0932a7cc41a482207c116d74180f in term 1.
I20260807 22:51:38.054198 1430 raft_consensus.cc:2454] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cb0932a7cc41a482207c116d74180f in term 1.
I20260807 22:51:38.054518 1220 leader_election.cc:302] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b6b65b78f3642f4aa8f85a9fc493697, b2cb0932a7cc41a482207c116d74180f; no voters:
I20260807 22:51:38.054709 1648 raft_consensus.cc:2781] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:38.054926 1648 raft_consensus.cc:686] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [term 1 LEADER]: Becoming Leader. State: Replica: b2cb0932a7cc41a482207c116d74180f, State: Running, Role: LEADER
I20260807 22:51:38.055229 1648 consensus_queue.cc:237] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 } } peers { permanent_uuid: "b2cb0932a7cc41a482207c116d74180f" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33333 } } peers { permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 } }
I20260807 22:51:38.058466 1138 catalog_manager.cc:5495] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cb0932a7cc41a482207c116d74180f (127.12.112.193). New cstate: current_term: 1 leader_uuid: "b2cb0932a7cc41a482207c116d74180f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2cb0932a7cc41a482207c116d74180f" member_type: VOTER last_known_addr { host: "127.12.112.193" port: 33333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260807 22:51:38.084689 1637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:38.081403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54972 (local address 127.12.112.193:33333)
0807 22:51:38.081535 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:38.081538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:38.081552 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:51:38.081642 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:38.081644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:38.081700 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:38.081792 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:51:38.082003 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:38.082569 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:38.083393 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:38.083595 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:38.083667 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:38.083921 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:51:38.084314 (+ 393us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:51:38.084411 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:38.084464 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 22:51:38.084511 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:51:38.090603 1430 raft_consensus.cc:1261] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697 [term 1 FOLLOWER]: Refusing update from remote peer b2cb0932a7cc41a482207c116d74180f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:38.090602 1570 raft_consensus.cc:1261] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105 [term 1 FOLLOWER]: Refusing update from remote peer b2cb0932a7cc41a482207c116d74180f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:51:38.091349 1648 consensus_queue.cc:1035] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b6b65b78f3642f4aa8f85a9fc493697" member_type: VOTER last_known_addr { host: "127.12.112.194" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:38.091585 1652 consensus_queue.cc:1035] T 226c1d2b581f41e4abc3f9f525114964 P b2cb0932a7cc41a482207c116d74180f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a19547abe0a14a98bf55f72baa8cc105" member_type: VOTER last_known_addr { host: "127.12.112.195" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:51:38.099085 1657 mvcc.cc:205] Tried to move back new op lower bound from 7316042129771270144 to 7316042129637146624. Current Snapshot: MvccSnapshot[applied={T|T < 7316042129771270144}]
I20260807 22:51:38.102643 1656 mvcc.cc:205] Tried to move back new op lower bound from 7316042129771270144 to 7316042129637146624. Current Snapshot: MvccSnapshot[applied={T|T < 7316042129771270144}]
I20260807 22:51:38.106500 1138 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:38.106639 1138 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:51:38.108915 1138 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e18871d61f2049ed8324fe8759230757: Sending DeleteTablet for 3 replicas of tablet 226c1d2b581f41e4abc3f9f525114964
I20260807 22:51:38.109690 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet 226c1d2b581f41e4abc3f9f525114964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:38 UTC) from {username='slave'} at 127.0.0.1:54956
I20260807 22:51:38.109812 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 226c1d2b581f41e4abc3f9f525114964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:38 UTC) from {username='slave'} at 127.0.0.1:58952
I20260807 22:51:38.110247 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 1202
I20260807 22:51:38.110357 1548 tablet_service.cc:1514] Processing DeleteTablet for tablet 226c1d2b581f41e4abc3f9f525114964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:51:38 UTC) from {username='slave'} at 127.0.0.1:40260
I20260807 22:51:38.112604 1666 tablet_replica.cc:330] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: stopping tablet replica
I20260807 22:51:38.112874 1666 raft_consensus.cc:2229] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:51:38.113157 1666 raft_consensus.cc:2258] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:38.113161 1668 tablet_replica.cc:330] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: stopping tablet replica
I20260807 22:51:38.113464 1668 raft_consensus.cc:2229] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:51:38.113742 1668 raft_consensus.cc:2258] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:51:38.114940 1668 ts_tablet_manager.cc:1905] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:38.114997 1666 ts_tablet_manager.cc:1905] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:51:38.117084 1668 ts_tablet_manager.cc:1918] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:38.117197 1668 log.cc:1196] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-2/wal/wals/226c1d2b581f41e4abc3f9f525114964
I20260807 22:51:38.117527 1668 ts_tablet_manager.cc:1939] T 226c1d2b581f41e4abc3f9f525114964 P a19547abe0a14a98bf55f72baa8cc105: Deleting consensus metadata
I20260807 22:51:38.118371 1666 ts_tablet_manager.cc:1918] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:51:38.118502 1666 log.cc:1196] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: Deleting WAL directory at /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142843719124-12739-0/minicluster-data/ts-1/wal/wals/226c1d2b581f41e4abc3f9f525114964
I20260807 22:51:38.118664 1125 catalog_manager.cc:4841] TS a19547abe0a14a98bf55f72baa8cc105 (127.12.112.195:32771): tablet 226c1d2b581f41e4abc3f9f525114964 (table test-table [id=122e54719f534c1897d9be8242bd375d]) successfully deleted
I20260807 22:51:38.118816 1666 ts_tablet_manager.cc:1939] T 226c1d2b581f41e4abc3f9f525114964 P 0b6b65b78f3642f4aa8f85a9fc493697: Deleting consensus metadata
W20260807 22:51:38.119959 1122 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.112.193:33333 (error 108)
I20260807 22:51:38.120226 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 1343
I20260807 22:51:38.120257 1125 catalog_manager.cc:4841] TS 0b6b65b78f3642f4aa8f85a9fc493697 (127.12.112.194:35257): tablet 226c1d2b581f41e4abc3f9f525114964 (table test-table [id=122e54719f534c1897d9be8242bd375d]) successfully deleted
I20260807 22:51:38.121302 1634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:38.120968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.193:33333 (local address 127.0.0.1:54988)
0807 22:51:38.121130 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:51:38.121209 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.193:33333: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 22:51:38.121480 1122 catalog_manager.cc:4584] TS b2cb0932a7cc41a482207c116d74180f (127.12.112.193:33333): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 226c1d2b581f41e4abc3f9f525114964: Network error: Client connection negotiation failed: client connection to 127.12.112.193:33333: connect: Connection refused (error 111)
I20260807 22:51:38.127022 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 1484
I20260807 22:51:38.133652 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 1106
2026-08-07T22:51:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1061 ms)
[----------] 6 tests from EncryptionPolicyTest (10417 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:38 dist-test-slave-tm1g krb5kdc[1672](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:38 dist-test-slave-tm1g krb5kdc[1672](info): set up 2 sockets
Aug 07 22:51:38 dist-test-slave-tm1g krb5kdc[1672](info): commencing operation
krb5kdc: starting...
W20260807 22:51:39.206152 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:39 dist-test-slave-tm1g krb5kdc[1672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:39.331199 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35287
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35287
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:39.440114 1685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:39.440358 1685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:39.440397 1685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:39.444393 1685 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:39.444447 1685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:39.444473 1685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:39.444489 1685 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:39.444536 1685 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:39.449605 1685 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35287
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:39.450615 1685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:39.451635 1685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:39.460018 1691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:39.460027 1690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:39.460140 1685 server_base.cc:1034] running on GCE node
W20260807 22:51:39.460027 1693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:39.460811 1685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:39.461895 1685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:39.463083 1685 hybrid_clock.cc:648] HybridClock initialized: now 1786143099463065 us; error 29 us; skew 500 ppm
Aug 07 22:51:39 dist-test-slave-tm1g krb5kdc[1672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143099, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:39.470893 1685 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:39.471710 1685 webserver.cc:460] Webserver started at http://127.0.0.1:42369/ using document root <none> and password file <none>
I20260807 22:51:39.472221 1685 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:39.472277 1685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:39.472443 1685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:39.474481 1685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "5a0967995ce24c7bbe85702440be2a36"
format_stamp: "Formatted at 2026-08-07 22:51:39 on dist-test-slave-tm1g"
server_key: "1398d0bdfedba71fdc9ac40538453d7d"
server_key_iv: "916da6ee0a335ccaf2ad0c68582f341f"
server_key_version: "encryptionkey@0"
I20260807 22:51:39.475014 1685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "5a0967995ce24c7bbe85702440be2a36"
format_stamp: "Formatted at 2026-08-07 22:51:39 on dist-test-slave-tm1g"
server_key: "1398d0bdfedba71fdc9ac40538453d7d"
server_key_iv: "916da6ee0a335ccaf2ad0c68582f341f"
server_key_version: "encryptionkey@0"
I20260807 22:51:39.478735 1685 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260807 22:51:39.481009 1701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:39.482227 1685 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:39.482394 1685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "5a0967995ce24c7bbe85702440be2a36"
format_stamp: "Formatted at 2026-08-07 22:51:39 on dist-test-slave-tm1g"
server_key: "1398d0bdfedba71fdc9ac40538453d7d"
server_key_iv: "916da6ee0a335ccaf2ad0c68582f341f"
server_key_version: "encryptionkey@0"
I20260807 22:51:39.482484 1685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:39.505420 1685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:39.508323 1685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:39.508479 1685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:39.515523 1685 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35287
I20260807 22:51:39.515547 1758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35287 every 8 connection(s)
I20260807 22:51:39.516467 1685 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:39.517230 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 1685
I20260807 22:51:39.517386 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:39.517688 12739 external_mini_cluster.cc:1428] Setting key 39b2fa97d4f18d35f6b0ee2f126f1757
I20260807 22:51:39.519622 1760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:39.526069 1760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36: Bootstrap starting.
Aug 07 22:51:39 dist-test-slave-tm1g krb5kdc[1672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:51:39.528470 1760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:39.529170 1760 log.cc:824] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:39.531102 1760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36: No bootstrap required, opened a new log
I20260807 22:51:39.532035 1763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:39.519049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44399 (local address 127.0.0.1:35287)
0807 22:51:39.519471 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:39.519486 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:39.519521 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:51:39.520207 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:39.520224 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:39.520547 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:39.520811 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:39.521710 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:39.522801 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:39.523969 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:39.524417 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:39.524525 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:39.527383 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:39.527388 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:39.527399 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:39.527426 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:39.529125 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:39.529645 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:39.529649 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:39.529653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:39.529757 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:39.530137 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:39.530141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:39.530143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:39.530590 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:39.530822 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:39.531124 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 22:51:39.531354 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":147,"threads_started":1}
I20260807 22:51:39.534308 1760 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0967995ce24c7bbe85702440be2a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35287 } }
I20260807 22:51:39.534580 1760 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:39.534641 1760 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0967995ce24c7bbe85702440be2a36, State: Initialized, Role: FOLLOWER
I20260807 22:51:39.535138 1760 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0967995ce24c7bbe85702440be2a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35287 } }
I20260807 22:51:39.535298 1760 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:39.535367 1760 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:39.535373 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:39.535456 1760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:39.536238 1760 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0967995ce24c7bbe85702440be2a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35287 } }
I20260807 22:51:39.536571 1760 leader_election.cc:302] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a0967995ce24c7bbe85702440be2a36; no voters:
I20260807 22:51:39.536815 1760 leader_election.cc:288] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:39.536954 1770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:39.537160 1770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [term 1 LEADER]: Becoming Leader. State: Replica: 5a0967995ce24c7bbe85702440be2a36, State: Running, Role: LEADER
I20260807 22:51:39.537465 1770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0967995ce24c7bbe85702440be2a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35287 } }
I20260807 22:51:39.538091 1760 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:39.539341 1771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a0967995ce24c7bbe85702440be2a36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0967995ce24c7bbe85702440be2a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35287 } } }
I20260807 22:51:39.539490 1771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:39.539806 1772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a0967995ce24c7bbe85702440be2a36. Latest consensus state: current_term: 1 leader_uuid: "5a0967995ce24c7bbe85702440be2a36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0967995ce24c7bbe85702440be2a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35287 } } }
I20260807 22:51:39.539884 1772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:39.539903 1780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:39.542753 1780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:39.548620 1780 catalog_manager.cc:1347] Generated new cluster ID: ed50179819b7449095e3328ea02c04a0
I20260807 22:51:39.548679 1780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:39.549435 1763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:39.537380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52687 (local address 127.0.0.1:35287)
0807 22:51:39.537479 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:39.537483 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:39.537962 (+ 479us) server_negotiation.cc:407] Connection header received
0807 22:51:39.538056 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:39.538059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:39.538105 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:39.538193 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:39.540995 (+ 2802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:39.541780 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:39.543538 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:39.543878 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:39.543989 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:39.545642 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:39.545645 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:39.545648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:39.545673 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:39.547414 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:39.547971 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:39.547975 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:39.547976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:39.548062 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:39.548480 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:39.548483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:39.548485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:39.548690 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:39.548834 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:39.549174 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 22:51:39.549264 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:51:39.561172 1780 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:39.562271 1780 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:39.569938 1780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a0967995ce24c7bbe85702440be2a36: Generated new TSK 0
I20260807 22:51:39.570689 1780 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:39.575492 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 1685
W20260807 22:51:39.583401 1670 connection.cc:535] client connection to 127.0.0.1:35287 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35287): Connection reset by peer (error 104)
2026-08-07T22:51:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1441 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:39 dist-test-slave-tm1g krb5kdc[1792](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:39 dist-test-slave-tm1g krb5kdc[1792](info): set up 2 sockets
Aug 07 22:51:39 dist-test-slave-tm1g krb5kdc[1792](info): commencing operation
krb5kdc: starting...
W20260807 22:51:40.629981 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:40 dist-test-slave-tm1g krb5kdc[1792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:40.749854 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35279
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:40.860190 1805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:40.860460 1805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:40.860531 1805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:40.864480 1805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:40.864559 1805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:40.864629 1805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:40.864686 1805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:40.864723 1805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:40.870232 1805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35279
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:40.871277 1805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:40.872246 1805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:40.880601 1810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:40.880618 1811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:40.880633 1805 server_base.cc:1034] running on GCE node
W20260807 22:51:40.880590 1813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:40.881313 1805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:40.882369 1805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:40.883563 1805 hybrid_clock.cc:648] HybridClock initialized: now 1786143100883545 us; error 31 us; skew 500 ppm
Aug 07 22:51:40 dist-test-slave-tm1g krb5kdc[1792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143100, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:40.886202 1805 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:40.887049 1805 webserver.cc:460] Webserver started at http://127.0.0.1:46079/ using document root <none> and password file <none>
I20260807 22:51:40.887570 1805 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:40.887660 1805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:40.887895 1805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:40.889802 1805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "a885a4ff44054e62b1ecce19e764fb93"
format_stamp: "Formatted at 2026-08-07 22:51:40 on dist-test-slave-tm1g"
server_key: "ce3f8bbe538c21b2081c6fda1485cdf5"
server_key_iv: "ad622729674634b8534657ae6ded13d6"
server_key_version: "encryptionkey@0"
I20260807 22:51:40.890429 1805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "a885a4ff44054e62b1ecce19e764fb93"
format_stamp: "Formatted at 2026-08-07 22:51:40 on dist-test-slave-tm1g"
server_key: "ce3f8bbe538c21b2081c6fda1485cdf5"
server_key_iv: "ad622729674634b8534657ae6ded13d6"
server_key_version: "encryptionkey@0"
I20260807 22:51:40.893877 1805 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:51:40.896190 1821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:40.897401 1805 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:40.897545 1805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "a885a4ff44054e62b1ecce19e764fb93"
format_stamp: "Formatted at 2026-08-07 22:51:40 on dist-test-slave-tm1g"
server_key: "ce3f8bbe538c21b2081c6fda1485cdf5"
server_key_iv: "ad622729674634b8534657ae6ded13d6"
server_key_version: "encryptionkey@0"
I20260807 22:51:40.897651 1805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:40.913769 1805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:40.916365 1805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:40.916555 1805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:40.923153 1805 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35279
I20260807 22:51:40.923174 1877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35279 every 8 connection(s)
I20260807 22:51:40.924023 1805 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:40.925679 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 1805
I20260807 22:51:40.925843 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:40.926141 12739 external_mini_cluster.cc:1428] Setting key e415a19479a60b98223645f03eafe7df
I20260807 22:51:40.926906 1878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:40.933732 1878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93: Bootstrap starting.
I20260807 22:51:40.936026 1881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:40.927411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35865 (local address 127.0.0.1:35279)
0807 22:51:40.927812 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:40.927829 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:40.927868 (+ 39us) server_negotiation.cc:407] Connection header received
0807 22:51:40.928689 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:40.928711 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:40.929099 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:40.929435 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:40.929830 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:40.931452 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:40.932348 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:40.933051 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:40.933207 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:40.934170 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:40.934176 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:40.934189 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:40.934676 (+ 487us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:40.934738 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:40.934768 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:40.934919 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:40.935042 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 22:51:40.935165 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":120,"threads_started":1}
I20260807 22:51:40.936342 1878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:40.937052 1878 log.cc:824] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:40.938798 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:40.939018 1878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93: No bootstrap required, opened a new log
I20260807 22:51:40.943428 1878 raft_consensus.cc:348] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a885a4ff44054e62b1ecce19e764fb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35279 } }
I20260807 22:51:40.943688 1878 raft_consensus.cc:374] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:40.943815 1878 raft_consensus.cc:729] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a885a4ff44054e62b1ecce19e764fb93, State: Initialized, Role: FOLLOWER
I20260807 22:51:40.944278 1878 consensus_queue.cc:260] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a885a4ff44054e62b1ecce19e764fb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35279 } }
I20260807 22:51:40.944418 1878 raft_consensus.cc:388] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:40.944484 1878 raft_consensus.cc:482] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:40.944587 1878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:40.945022 1881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:40.940993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35249 (local address 127.0.0.1:35279)
0807 22:51:40.941115 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:40.941121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:40.941246 (+ 125us) server_negotiation.cc:407] Connection header received
0807 22:51:40.941311 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:40.941315 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:40.941366 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:40.941457 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:40.941692 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:40.942461 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:40.943243 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:40.943586 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:40.943698 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:40.944592 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:40.944598 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:40.944603 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:40.944617 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:40.944643 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:40.944659 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:40.944757 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:40.944866 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 22:51:40.944901 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:51:40.945668 1878 raft_consensus.cc:504] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a885a4ff44054e62b1ecce19e764fb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35279 } }
I20260807 22:51:40.946005 1878 leader_election.cc:302] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a885a4ff44054e62b1ecce19e764fb93; no voters:
I20260807 22:51:40.946295 1878 leader_election.cc:288] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:40.946462 1888 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:40.946676 1888 raft_consensus.cc:686] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [term 1 LEADER]: Becoming Leader. State: Replica: a885a4ff44054e62b1ecce19e764fb93, State: Running, Role: LEADER
I20260807 22:51:40.947002 1888 consensus_queue.cc:237] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a885a4ff44054e62b1ecce19e764fb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35279 } }
I20260807 22:51:40.947479 1878 sys_catalog.cc:564] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:40.948974 1890 sys_catalog.cc:455] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a885a4ff44054e62b1ecce19e764fb93. Latest consensus state: current_term: 1 leader_uuid: "a885a4ff44054e62b1ecce19e764fb93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a885a4ff44054e62b1ecce19e764fb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35279 } } }
I20260807 22:51:40.949023 1889 sys_catalog.cc:455] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a885a4ff44054e62b1ecce19e764fb93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a885a4ff44054e62b1ecce19e764fb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35279 } } }
I20260807 22:51:40.949112 1889 sys_catalog.cc:458] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:40.949112 1890 sys_catalog.cc:458] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:40.949482 1903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:40.952306 1903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:40.957363 1903 catalog_manager.cc:1347] Generated new cluster ID: aec1ebfbfde646caa5f6d03a3510ba51
I20260807 22:51:40.957428 1903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:40.972218 1903 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:40.973052 1903 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:40.977833 1903 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a885a4ff44054e62b1ecce19e764fb93: Generated new TSK 0
I20260807 22:51:40.978446 1903 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:40.988389 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 1805
W20260807 22:51:40.995750 1790 connection.cc:535] client connection to 127.0.0.1:35279 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35279): Connection reset by peer (error 104)
2026-08-07T22:51:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1412 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:41 dist-test-slave-tm1g krb5kdc[1910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:41 dist-test-slave-tm1g krb5kdc[1910](info): set up 2 sockets
Aug 07 22:51:41 dist-test-slave-tm1g krb5kdc[1910](info): commencing operation
krb5kdc: starting...
W20260807 22:51:42.049685 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:42 dist-test-slave-tm1g krb5kdc[1910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:42.170791 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42345
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:42.278453 1924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:42.278697 1924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:42.278736 1924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:42.282557 1924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:42.282603 1924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:42.282622 1924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:42.282639 1924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:42.282653 1924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:42.287714 1924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42345
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:42.288627 1924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:42.289575 1924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:42.297856 1932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:42.297861 1929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:42.297871 1930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:42.298081 1924 server_base.cc:1034] running on GCE node
I20260807 22:51:42.298849 1924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:42.299938 1924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:42.301127 1924 hybrid_clock.cc:648] HybridClock initialized: now 1786143102301109 us; error 30 us; skew 500 ppm
Aug 07 22:51:42 dist-test-slave-tm1g krb5kdc[1910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143102, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:42.304628 1924 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:42.305445 1924 webserver.cc:460] Webserver started at http://127.0.0.1:41049/ using document root <none> and password file <none>
I20260807 22:51:42.305994 1924 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:42.306085 1924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:42.306288 1924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:42.308267 1924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799"
format_stamp: "Formatted at 2026-08-07 22:51:42 on dist-test-slave-tm1g"
server_key: "df3056f1cec8869c044c81236820148a"
server_key_iv: "e3610a36ea8ef2334930b46c5c8d7e78"
server_key_version: "encryptionkey@0"
I20260807 22:51:42.308842 1924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799"
format_stamp: "Formatted at 2026-08-07 22:51:42 on dist-test-slave-tm1g"
server_key: "df3056f1cec8869c044c81236820148a"
server_key_iv: "e3610a36ea8ef2334930b46c5c8d7e78"
server_key_version: "encryptionkey@0"
I20260807 22:51:42.312378 1924 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 22:51:42.314683 1940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:42.315802 1924 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:42.315939 1924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799"
format_stamp: "Formatted at 2026-08-07 22:51:42 on dist-test-slave-tm1g"
server_key: "df3056f1cec8869c044c81236820148a"
server_key_iv: "e3610a36ea8ef2334930b46c5c8d7e78"
server_key_version: "encryptionkey@0"
I20260807 22:51:42.316048 1924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:42.320403 1924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:42.323120 1924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:42.323310 1924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:42.329875 1924 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42345
I20260807 22:51:42.329950 1995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42345 every 8 connection(s)
I20260807 22:51:42.330792 1924 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:42.333379 1996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:42.336176 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 1924
I20260807 22:51:42.336336 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:42.336652 12739 external_mini_cluster.cc:1428] Setting key f51a7cdbe4e2acb62e66ab09420a3ea0
I20260807 22:51:42.339253 1996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799: Bootstrap starting.
I20260807 22:51:42.341572 1996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:42.341668 1999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:42.338016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34297 (local address 127.0.0.1:42345)
0807 22:51:42.338496 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:42.338511 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:42.338545 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:51:42.339130 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:42.339146 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:42.339455 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:42.339773 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:42.340550 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:42.340554 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:42.340565 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:42.340575 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:42.340625 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:42.340643 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:42.340787 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:42.340855 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 22:51:42.341012 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":134,"threads_started":1}
I20260807 22:51:42.342387 1996 log.cc:824] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:42.344439 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:42.344584 1996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799: No bootstrap required, opened a new log
I20260807 22:51:42.348028 1999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:42.346440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38387 (local address 127.0.0.1:42345)
0807 22:51:42.346558 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:42.346562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:42.346770 (+ 208us) server_negotiation.cc:407] Connection header received
0807 22:51:42.346862 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:42.346865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:42.346898 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:42.346986 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:42.347654 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:42.347660 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:42.347663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:42.347675 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:42.347707 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:42.347724 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:42.347829 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:42.347866 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 22:51:42.347899 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:51:42.348773 1996 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42345 } }
I20260807 22:51:42.349030 1996 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:42.349095 1996 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a3f09ba0cfd4ecebe8fd21447aa5799, State: Initialized, Role: FOLLOWER
I20260807 22:51:42.349468 1996 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42345 } }
I20260807 22:51:42.349581 1996 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:42.349623 1996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:42.349689 1996 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:42.350711 1996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42345 } }
I20260807 22:51:42.351037 1996 leader_election.cc:302] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a3f09ba0cfd4ecebe8fd21447aa5799; no voters:
I20260807 22:51:42.351277 1996 leader_election.cc:288] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:42.351428 2006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:42.351672 2006 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [term 1 LEADER]: Becoming Leader. State: Replica: 5a3f09ba0cfd4ecebe8fd21447aa5799, State: Running, Role: LEADER
I20260807 22:51:42.351984 2006 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42345 } }
I20260807 22:51:42.352435 1996 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:42.353710 2007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42345 } } }
I20260807 22:51:42.353744 2008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a3f09ba0cfd4ecebe8fd21447aa5799. Latest consensus state: current_term: 1 leader_uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3f09ba0cfd4ecebe8fd21447aa5799" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42345 } } }
I20260807 22:51:42.353900 2007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:42.353904 2008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799 [sys.catalog]: This master's current role is: LEADER
W20260807 22:51:42.357090 2021 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:51:42.357218 2021 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:51:42.357328 2018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:42.358235 2018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:42.363626 2018 catalog_manager.cc:1347] Generated new cluster ID: 231cd65368d6480985c099d6a8ded06a
I20260807 22:51:42.363698 2018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:42.400090 2018 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:42.400413 2018 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:42.408545 2018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a3f09ba0cfd4ecebe8fd21447aa5799: Generated new TSK 0
I20260807 22:51:42.409164 2018 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:42.416944 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 1924
2026-08-07T22:51:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1427 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:42 dist-test-slave-tm1g krb5kdc[2027](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:42 dist-test-slave-tm1g krb5kdc[2027](info): set up 2 sockets
Aug 07 22:51:42 dist-test-slave-tm1g krb5kdc[2027](info): commencing operation
krb5kdc: starting...
W20260807 22:51:43.477517 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:43 dist-test-slave-tm1g krb5kdc[2027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143103, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:43.596959 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37069
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:43.704896 2041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:43.705161 2041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:43.705232 2041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:43.709291 2041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:43.709376 2041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:43.709416 2041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:43.709470 2041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:43.709509 2041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:43.714478 2041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:43.715402 2041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:43.716342 2041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:43.724805 2046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:43.724810 2047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:43.724869 2050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:43.725077 2041 server_base.cc:1034] running on GCE node
I20260807 22:51:43.725699 2041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:43.726810 2041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:43.727967 2041 hybrid_clock.cc:648] HybridClock initialized: now 1786143103727952 us; error 30 us; skew 500 ppm
Aug 07 22:51:43 dist-test-slave-tm1g krb5kdc[2027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143103, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:43.730710 2041 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:43.731577 2041 webserver.cc:460] Webserver started at http://127.0.0.1:35153/ using document root <none> and password file <none>
I20260807 22:51:43.732106 2041 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:43.732197 2041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:43.732443 2041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:43.734424 2041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "518c1f1dac684ee7bec79b6cf0d2e936"
format_stamp: "Formatted at 2026-08-07 22:51:43 on dist-test-slave-tm1g"
server_key: "6eac4f5574bf28ec845197c2adcd6769"
server_key_iv: "a794aac048b83b0ad2e14383625bce60"
server_key_version: "encryptionkey@0"
I20260807 22:51:43.734982 2041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "518c1f1dac684ee7bec79b6cf0d2e936"
format_stamp: "Formatted at 2026-08-07 22:51:43 on dist-test-slave-tm1g"
server_key: "6eac4f5574bf28ec845197c2adcd6769"
server_key_iv: "a794aac048b83b0ad2e14383625bce60"
server_key_version: "encryptionkey@0"
I20260807 22:51:43.738595 2041 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:51:43.742154 2058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:43.743801 2041 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:51:43.743919 2041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "518c1f1dac684ee7bec79b6cf0d2e936"
format_stamp: "Formatted at 2026-08-07 22:51:43 on dist-test-slave-tm1g"
server_key: "6eac4f5574bf28ec845197c2adcd6769"
server_key_iv: "a794aac048b83b0ad2e14383625bce60"
server_key_version: "encryptionkey@0"
I20260807 22:51:43.744035 2041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:43.759209 2041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:43.761780 2041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:43.761977 2041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:43.768801 2041 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37069
I20260807 22:51:43.768829 2113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37069 every 8 connection(s)
I20260807 22:51:43.769686 2041 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:43.772291 2114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:43.772419 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 2041
I20260807 22:51:43.772578 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:43.772886 12739 external_mini_cluster.cc:1428] Setting key 4486657f5e9502c6ae7bbde887e74d43
I20260807 22:51:43.779214 2114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936: Bootstrap starting.
I20260807 22:51:43.781287 2114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936: Neither blocks nor log segments found. Creating new log.
Aug 07 22:51:43 dist-test-slave-tm1g krb5kdc[2027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143103, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:51:43.782217 2114 log.cc:824] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:43.784335 2114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936: No bootstrap required, opened a new log
I20260807 22:51:43.787294 2117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:43.774237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50095 (local address 127.0.0.1:37069)
0807 22:51:43.774743 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:43.774761 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:43.774803 (+ 42us) server_negotiation.cc:407] Connection header received
0807 22:51:43.775560 (+ 757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:43.775584 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:43.776006 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:43.776355 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:43.777024 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:43.778539 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:43.779390 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:43.779843 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:43.780043 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:43.782805 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:43.782814 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:43.782831 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:43.782859 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:43.784576 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:43.785071 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:43.785075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:43.785080 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:43.785185 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:43.785492 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:43.785495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:43.785496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:43.785844 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:43.785986 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:43.786279 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 22:51:43.786626 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":135,"threads_started":1}
I20260807 22:51:43.788309 2114 raft_consensus.cc:348] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "518c1f1dac684ee7bec79b6cf0d2e936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } }
I20260807 22:51:43.788519 2114 raft_consensus.cc:374] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:43.788580 2114 raft_consensus.cc:729] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c1f1dac684ee7bec79b6cf0d2e936, State: Initialized, Role: FOLLOWER
I20260807 22:51:43.788985 2114 consensus_queue.cc:260] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "518c1f1dac684ee7bec79b6cf0d2e936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } }
I20260807 22:51:43.789150 2114 raft_consensus.cc:388] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:43.789222 2114 raft_consensus.cc:482] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:43.789321 2114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:43.790115 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:43.790450 2114 raft_consensus.cc:504] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "518c1f1dac684ee7bec79b6cf0d2e936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } }
I20260807 22:51:43.790802 2114 leader_election.cc:302] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 518c1f1dac684ee7bec79b6cf0d2e936; no voters:
I20260807 22:51:43.791126 2114 leader_election.cc:288] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:43.791234 2119 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:43.791507 2119 raft_consensus.cc:686] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [term 1 LEADER]: Becoming Leader. State: Replica: 518c1f1dac684ee7bec79b6cf0d2e936, State: Running, Role: LEADER
I20260807 22:51:43.791810 2119 consensus_queue.cc:237] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "518c1f1dac684ee7bec79b6cf0d2e936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } }
I20260807 22:51:43.792389 2114 sys_catalog.cc:564] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:43.792972 2120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 518c1f1dac684ee7bec79b6cf0d2e936. Latest consensus state: current_term: 1 leader_uuid: "518c1f1dac684ee7bec79b6cf0d2e936" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "518c1f1dac684ee7bec79b6cf0d2e936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } } }
I20260807 22:51:43.793128 2120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:43.793591 2130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:43.793570 2123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "518c1f1dac684ee7bec79b6cf0d2e936" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "518c1f1dac684ee7bec79b6cf0d2e936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37069 } } }
I20260807 22:51:43.793794 2123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:43.796737 2130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:43.801626 2117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:43.792626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42247 (local address 127.0.0.1:37069)
0807 22:51:43.792754 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:43.792760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:43.793183 (+ 423us) server_negotiation.cc:407] Connection header received
0807 22:51:43.793230 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:43.793234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:43.793286 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:43.793366 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:43.794363 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:43.795146 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:43.796278 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:43.796627 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:43.796754 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:43.798142 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:43.798145 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:43.798148 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:43.798173 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:43.799903 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:43.800399 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:43.800402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:43.800404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:43.800495 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:43.800779 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:43.800783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:43.800785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:43.801005 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:43.801138 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:43.801396 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 22:51:43.801487 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:51:43.803018 2130 catalog_manager.cc:1347] Generated new cluster ID: 5f65755953704a658caaf463dd49cab7
I20260807 22:51:43.803092 2130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:43.815337 2130 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:43.816443 2130 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:43.827598 2130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 518c1f1dac684ee7bec79b6cf0d2e936: Generated new TSK 0
I20260807 22:51:43.828301 2130 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:43.836297 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 2041
2026-08-07T22:51:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:43 dist-test-slave-tm1g krb5kdc[2146](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:43 dist-test-slave-tm1g krb5kdc[2146](info): set up 2 sockets
Aug 07 22:51:43 dist-test-slave-tm1g krb5kdc[2146](info): commencing operation
krb5kdc: starting...
W20260807 22:51:44.897490 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:44 dist-test-slave-tm1g krb5kdc[2146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:45.015318 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42957
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:45.122874 2162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:45.123108 2162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:45.123147 2162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:45.127142 2162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:45.127197 2162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:45.127216 2162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:45.127233 2162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:45.127249 2162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:45.132440 2162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:45.133419 2162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:45.134428 2162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:45.142679 2168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:45.142685 2167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:45.142781 2162 server_base.cc:1034] running on GCE node
W20260807 22:51:45.142932 2170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:45.143411 2162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:45.144488 2162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:45.145679 2162 hybrid_clock.cc:648] HybridClock initialized: now 1786143105145654 us; error 39 us; skew 500 ppm
Aug 07 22:51:45 dist-test-slave-tm1g krb5kdc[2146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143105, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:45.153728 2162 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:45.154680 2162 webserver.cc:460] Webserver started at http://127.0.0.1:42701/ using document root <none> and password file <none>
I20260807 22:51:45.155231 2162 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:45.155323 2162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:45.155560 2162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:45.157591 2162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "8c82fce8a1234ad595b51d3a90f280e8"
format_stamp: "Formatted at 2026-08-07 22:51:45 on dist-test-slave-tm1g"
server_key: "bbfd12f1a690ccafed5fa4e850127796"
server_key_iv: "1a3bc1595c10f037b9c88a1b2b8f862f"
server_key_version: "encryptionkey@0"
I20260807 22:51:45.158161 2162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "8c82fce8a1234ad595b51d3a90f280e8"
format_stamp: "Formatted at 2026-08-07 22:51:45 on dist-test-slave-tm1g"
server_key: "bbfd12f1a690ccafed5fa4e850127796"
server_key_iv: "1a3bc1595c10f037b9c88a1b2b8f862f"
server_key_version: "encryptionkey@0"
I20260807 22:51:45.161774 2162 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260807 22:51:45.164142 2177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:45.165287 2162 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:45.165439 2162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "8c82fce8a1234ad595b51d3a90f280e8"
format_stamp: "Formatted at 2026-08-07 22:51:45 on dist-test-slave-tm1g"
server_key: "bbfd12f1a690ccafed5fa4e850127796"
server_key_iv: "1a3bc1595c10f037b9c88a1b2b8f862f"
server_key_version: "encryptionkey@0"
I20260807 22:51:45.165551 2162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:45.181500 2162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:45.184165 2162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:45.184373 2162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:45.191563 2162 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42957
I20260807 22:51:45.191578 2235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42957 every 8 connection(s)
I20260807 22:51:45.192452 2162 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:45.195055 2236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:45.200300 2236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8: Bootstrap starting.
I20260807 22:51:45.200875 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 2162
I20260807 22:51:45.201022 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:45.201313 12739 external_mini_cluster.cc:1428] Setting key 91d738db8cbae685c7758ec27a385dbc
I20260807 22:51:45.203099 2236 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:45.203816 2236 log.cc:824] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:45.205775 2236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8: No bootstrap required, opened a new log
I20260807 22:51:45.209262 2236 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c82fce8a1234ad595b51d3a90f280e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42957 } }
I20260807 22:51:45.209486 2236 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:45.209543 2236 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c82fce8a1234ad595b51d3a90f280e8, State: Initialized, Role: FOLLOWER
I20260807 22:51:45.209940 2236 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c82fce8a1234ad595b51d3a90f280e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42957 } }
I20260807 22:51:45.210057 2236 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:45.210139 2236 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:45.210147 2239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:45.202627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55625 (local address 127.0.0.1:42957)
0807 22:51:45.203041 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:45.203056 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:45.203089 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:51:45.203738 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:45.203754 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:45.204119 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:45.204498 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:45.204856 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:45.205806 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:45.206834 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:45.207310 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:45.207489 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:45.208336 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:45.208340 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:45.208352 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:45.208708 (+ 356us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:45.208761 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:45.208785 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:45.208893 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:45.209008 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 22:51:45.209204 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":141,"threads_started":1}
I20260807 22:51:45.210279 2236 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:45.211119 2236 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c82fce8a1234ad595b51d3a90f280e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42957 } }
I20260807 22:51:45.211459 2236 leader_election.cc:302] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c82fce8a1234ad595b51d3a90f280e8; no voters:
I20260807 22:51:45.211777 2236 leader_election.cc:288] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:45.211838 2241 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:45.212051 2241 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [term 1 LEADER]: Becoming Leader. State: Replica: 8c82fce8a1234ad595b51d3a90f280e8, State: Running, Role: LEADER
I20260807 22:51:45.212841 2241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c82fce8a1234ad595b51d3a90f280e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42957 } }
I20260807 22:51:45.213028 2236 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:45.213039 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:45.214550 2243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c82fce8a1234ad595b51d3a90f280e8. Latest consensus state: current_term: 1 leader_uuid: "8c82fce8a1234ad595b51d3a90f280e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c82fce8a1234ad595b51d3a90f280e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42957 } } }
I20260807 22:51:45.214709 2243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:45.215044 2242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c82fce8a1234ad595b51d3a90f280e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c82fce8a1234ad595b51d3a90f280e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42957 } } }
I20260807 22:51:45.215332 2242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8 [sys.catalog]: This master's current role is: LEADER
W20260807 22:51:45.218071 2261 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:51:45.218465 2261 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:51:45.218569 2257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:45.219398 2257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:45.219421 2239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:45.215262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45633 (local address 127.0.0.1:42957)
0807 22:51:45.215363 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:45.215370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:45.215718 (+ 348us) server_negotiation.cc:407] Connection header received
0807 22:51:45.215906 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:45.215911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:45.215964 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:45.216022 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:45.216438 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:45.217016 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:45.217815 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:45.218050 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:45.218162 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:45.218972 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:45.218975 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:45.218978 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:45.218990 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:45.219022 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:45.219033 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:45.219125 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:45.219215 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 22:51:45.219267 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 22:51:45.224392 2257 catalog_manager.cc:1347] Generated new cluster ID: 6918ac5feaf149b7b359216f46a240f8
I20260807 22:51:45.224462 2257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:45.234920 2257 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:45.235980 2257 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:45.241194 2257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c82fce8a1234ad595b51d3a90f280e8: Generated new TSK 0
I20260807 22:51:45.241859 2257 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:45.253751 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 2162
2026-08-07T22:51:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1417 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:45 dist-test-slave-tm1g krb5kdc[2268](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:45 dist-test-slave-tm1g krb5kdc[2268](info): set up 2 sockets
Aug 07 22:51:45 dist-test-slave-tm1g krb5kdc[2268](info): commencing operation
krb5kdc: starting...
W20260807 22:51:46.318462 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:46 dist-test-slave-tm1g krb5kdc[2268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:46.437206 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45811
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:46.544131 2281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:46.544363 2281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:46.544402 2281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:46.548385 2281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:46.548439 2281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:46.548458 2281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:46.548475 2281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:46.548489 2281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:46.553489 2281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:46.554483 2281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:46.555420 2281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:46.563776 2286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:46.563803 2289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:46.563853 2281 server_base.cc:1034] running on GCE node
W20260807 22:51:46.563759 2287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:46.564556 2281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:46.565562 2281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:46.566761 2281 hybrid_clock.cc:648] HybridClock initialized: now 1786143106566738 us; error 31 us; skew 500 ppm
Aug 07 22:51:46 dist-test-slave-tm1g krb5kdc[2268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143106, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:46.569505 2281 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:46.570366 2281 webserver.cc:460] Webserver started at http://127.0.0.1:42381/ using document root <none> and password file <none>
I20260807 22:51:46.570906 2281 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:46.570998 2281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:46.571228 2281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:46.573222 2281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "bca6fb93cc33427a94c39b54dd5658d9"
format_stamp: "Formatted at 2026-08-07 22:51:46 on dist-test-slave-tm1g"
server_key: "e93efb0483f7d5716d5f3d5cb591e4f7"
server_key_iv: "fe38d5de013edb522aa4d27e62d6c303"
server_key_version: "encryptionkey@0"
I20260807 22:51:46.573765 2281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "bca6fb93cc33427a94c39b54dd5658d9"
format_stamp: "Formatted at 2026-08-07 22:51:46 on dist-test-slave-tm1g"
server_key: "e93efb0483f7d5716d5f3d5cb591e4f7"
server_key_iv: "fe38d5de013edb522aa4d27e62d6c303"
server_key_version: "encryptionkey@0"
I20260807 22:51:46.577421 2281 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:51:46.579780 2297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:46.581048 2281 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:51:46.581207 2281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "bca6fb93cc33427a94c39b54dd5658d9"
format_stamp: "Formatted at 2026-08-07 22:51:46 on dist-test-slave-tm1g"
server_key: "e93efb0483f7d5716d5f3d5cb591e4f7"
server_key_iv: "fe38d5de013edb522aa4d27e62d6c303"
server_key_version: "encryptionkey@0"
I20260807 22:51:46.581319 2281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:46.585759 2281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:46.588792 2281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:46.588987 2281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:46.595765 2281 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45811
I20260807 22:51:46.595840 2352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45811 every 8 connection(s)
I20260807 22:51:46.596645 2281 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:46.599431 2354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:46.602654 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 2281
I20260807 22:51:46.602813 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:46.603111 12739 external_mini_cluster.cc:1428] Setting key c314d12ea9ddff5b477517769fbbcedd
I20260807 22:51:46.605373 2354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9: Bootstrap starting.
I20260807 22:51:46.607977 2354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:46.608451 2357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:46.604467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50077 (local address 127.0.0.1:45811)
0807 22:51:46.604881 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:46.604899 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:46.604939 (+ 40us) server_negotiation.cc:407] Connection header received
0807 22:51:46.605747 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:46.605781 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:46.606103 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:46.606491 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:46.607115 (+ 624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:46.607120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:46.607133 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:46.607143 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:46.607192 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:46.607213 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:46.607345 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:46.607413 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 22:51:46.607548 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":98,"threads_started":1}
I20260807 22:51:46.608820 2354 log.cc:824] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:46.610859 2354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9: No bootstrap required, opened a new log
I20260807 22:51:46.611281 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:46.614794 2357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:46.613219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45181 (local address 127.0.0.1:45811)
0807 22:51:46.613343 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:46.613349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:46.613504 (+ 155us) server_negotiation.cc:407] Connection header received
0807 22:51:46.613654 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:46.613656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:46.613681 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:46.613743 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:46.614424 (+ 681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:46.614427 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:46.614428 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:46.614438 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:46.614461 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:46.614471 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:46.614539 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:46.614647 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 22:51:46.614674 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:51:46.615039 2354 raft_consensus.cc:348] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca6fb93cc33427a94c39b54dd5658d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } }
I20260807 22:51:46.615324 2354 raft_consensus.cc:374] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:46.615386 2354 raft_consensus.cc:729] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bca6fb93cc33427a94c39b54dd5658d9, State: Initialized, Role: FOLLOWER
I20260807 22:51:46.615828 2354 consensus_queue.cc:260] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca6fb93cc33427a94c39b54dd5658d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } }
I20260807 22:51:46.615980 2354 raft_consensus.cc:388] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:46.616044 2354 raft_consensus.cc:482] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:46.616137 2354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:46.616984 2354 raft_consensus.cc:504] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca6fb93cc33427a94c39b54dd5658d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } }
I20260807 22:51:46.617317 2354 leader_election.cc:302] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bca6fb93cc33427a94c39b54dd5658d9; no voters:
I20260807 22:51:46.617606 2354 leader_election.cc:288] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:46.617712 2364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:46.617950 2364 raft_consensus.cc:686] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [term 1 LEADER]: Becoming Leader. State: Replica: bca6fb93cc33427a94c39b54dd5658d9, State: Running, Role: LEADER
I20260807 22:51:46.618582 2364 consensus_queue.cc:237] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca6fb93cc33427a94c39b54dd5658d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } }
I20260807 22:51:46.618907 2354 sys_catalog.cc:564] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:46.620044 2365 sys_catalog.cc:455] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bca6fb93cc33427a94c39b54dd5658d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca6fb93cc33427a94c39b54dd5658d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } } }
I20260807 22:51:46.620167 2365 sys_catalog.cc:458] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:46.620572 2373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:46.620527 2366 sys_catalog.cc:455] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bca6fb93cc33427a94c39b54dd5658d9. Latest consensus state: current_term: 1 leader_uuid: "bca6fb93cc33427a94c39b54dd5658d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca6fb93cc33427a94c39b54dd5658d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } } }
I20260807 22:51:46.620673 2366 sys_catalog.cc:458] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:46.623626 2373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:46.628321 2373 catalog_manager.cc:1347] Generated new cluster ID: 121c17ea55444b8e8779bccf45f00f07
I20260807 22:51:46.628394 2373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:46.636519 2373 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:46.636801 2373 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:46.640069 2373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bca6fb93cc33427a94c39b54dd5658d9: Generated new TSK 0
I20260807 22:51:46.640780 2373 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:46.646106 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 2281
2026-08-07T22:51:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1391 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:46 dist-test-slave-tm1g krb5kdc[2385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:46 dist-test-slave-tm1g krb5kdc[2385](info): set up 2 sockets
Aug 07 22:51:46 dist-test-slave-tm1g krb5kdc[2385](info): commencing operation
krb5kdc: starting...
W20260807 22:51:47.705572 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:47 dist-test-slave-tm1g krb5kdc[2385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143107, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:47.826835 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38423
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38423
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:47.934999 2398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:47.935297 2398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:47.935371 2398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:47.939285 2398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:47.939368 2398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:47.939407 2398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:47.939464 2398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:47.939505 2398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:47.944506 2398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:47.945508 2398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:47.946514 2398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:47.954658 2406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:47.954664 2404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:47.954789 2398 server_base.cc:1034] running on GCE node
W20260807 22:51:47.954967 2403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:47.955554 2398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:47.956588 2398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:47.957785 2398 hybrid_clock.cc:648] HybridClock initialized: now 1786143107957766 us; error 30 us; skew 500 ppm
Aug 07 22:51:47 dist-test-slave-tm1g krb5kdc[2385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143107, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:47.960531 2398 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:47.961437 2398 webserver.cc:460] Webserver started at http://127.0.0.1:36787/ using document root <none> and password file <none>
I20260807 22:51:47.961968 2398 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:47.962062 2398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:47.962288 2398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:47.964295 2398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "21169c1753404e88a203949d35e91463"
format_stamp: "Formatted at 2026-08-07 22:51:47 on dist-test-slave-tm1g"
server_key: "7c4738b4a9f3b2c2aeda051c3d5943c9"
server_key_iv: "6eed2d3e79a1b92a978b2b450bb40b22"
server_key_version: "encryptionkey@0"
I20260807 22:51:47.964872 2398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "21169c1753404e88a203949d35e91463"
format_stamp: "Formatted at 2026-08-07 22:51:47 on dist-test-slave-tm1g"
server_key: "7c4738b4a9f3b2c2aeda051c3d5943c9"
server_key_iv: "6eed2d3e79a1b92a978b2b450bb40b22"
server_key_version: "encryptionkey@0"
I20260807 22:51:47.968436 2398 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260807 22:51:47.970693 2414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:47.971844 2398 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:47.971987 2398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "21169c1753404e88a203949d35e91463"
format_stamp: "Formatted at 2026-08-07 22:51:47 on dist-test-slave-tm1g"
server_key: "7c4738b4a9f3b2c2aeda051c3d5943c9"
server_key_iv: "6eed2d3e79a1b92a978b2b450bb40b22"
server_key_version: "encryptionkey@0"
I20260807 22:51:47.972092 2398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:47.986245 2398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:47.989018 2398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:47.989212 2398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:47.996120 2398 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38423
I20260807 22:51:47.996137 2468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38423 every 8 connection(s)
I20260807 22:51:47.997045 2398 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:47.999617 2469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:48.002662 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 2398
I20260807 22:51:48.002825 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:48.003123 12739 external_mini_cluster.cc:1428] Setting key 566d129e83d998e884f02f36177369e3
I20260807 22:51:48.005270 2469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463: Bootstrap starting.
I20260807 22:51:48.007688 2469 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:48.008494 2469 log.cc:824] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:48.010519 2469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463: No bootstrap required, opened a new log
Aug 07 22:51:48 dist-test-slave-tm1g krb5kdc[2385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143107, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:51:48.014931 2469 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21169c1753404e88a203949d35e91463" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38423 } }
I20260807 22:51:48.015213 2469 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:48.015275 2469 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21169c1753404e88a203949d35e91463, State: Initialized, Role: FOLLOWER
I20260807 22:51:48.015736 2469 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21169c1753404e88a203949d35e91463" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38423 } }
I20260807 22:51:48.015908 2469 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:48.015985 2469 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:48.016081 2469 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:48.017135 2469 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21169c1753404e88a203949d35e91463" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38423 } }
I20260807 22:51:48.017474 2469 leader_election.cc:302] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21169c1753404e88a203949d35e91463; no voters:
I20260807 22:51:48.017776 2469 leader_election.cc:288] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:48.017882 2474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:48.018024 2472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:48.004395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:44943 (local address 127.0.0.1:38423)
0807 22:51:48.004785 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:48.004802 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:48.004844 (+ 42us) server_negotiation.cc:407] Connection header received
0807 22:51:48.005517 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:48.005534 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:48.005850 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:48.006119 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:48.007048 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:48.008105 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:48.009213 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:48.009673 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:48.009788 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:48.012785 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:48.012790 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:48.012805 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:48.012834 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:48.014886 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:48.015450 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:48.015455 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:48.015460 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:48.015590 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:48.015909 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:48.015921 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:48.015925 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:48.016423 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:48.016642 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:48.016859 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 22:51:48.017099 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":136,"threads_started":1}
I20260807 22:51:48.018117 2474 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [term 1 LEADER]: Becoming Leader. State: Replica: 21169c1753404e88a203949d35e91463, State: Running, Role: LEADER
I20260807 22:51:48.018639 2474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21169c1753404e88a203949d35e91463" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38423 } }
I20260807 22:51:48.018998 2469 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:48.021518 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:48.021878 2476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21169c1753404e88a203949d35e91463. Latest consensus state: current_term: 1 leader_uuid: "21169c1753404e88a203949d35e91463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21169c1753404e88a203949d35e91463" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38423 } } }
I20260807 22:51:48.021908 2475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21169c1753404e88a203949d35e91463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21169c1753404e88a203949d35e91463" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38423 } } }
I20260807 22:51:48.022022 2476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:48.022051 2475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463 [sys.catalog]: This master's current role is: LEADER
W20260807 22:51:48.024137 2490 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:51:48.024252 2490 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:51:48.024374 2492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:48.025215 2492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:48.031028 2492 catalog_manager.cc:1347] Generated new cluster ID: a0142cd56d9140ea99972d1d1c3e7984
I20260807 22:51:48.031085 2492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:48.031854 2472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:48.023684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:32873 (local address 127.0.0.1:38423)
0807 22:51:48.023786 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:48.023790 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:48.024032 (+ 242us) server_negotiation.cc:407] Connection header received
0807 22:51:48.024172 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:48.024175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:48.024221 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:48.024303 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:48.024981 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:48.025534 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:48.026376 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:48.026613 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:48.026726 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:48.028050 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:48.028054 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:48.028057 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:48.028087 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:48.029867 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:48.030359 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:48.030363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:48.030367 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:48.030445 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:48.030824 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:48.030829 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:48.030831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:48.031031 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:48.031150 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:48.031603 (+ 453us) server_negotiation.cc:299] Negotiation successful
0807 22:51:48.031703 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:51:48.039062 2492 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:48.039844 2492 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:48.051343 2492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21169c1753404e88a203949d35e91463: Generated new TSK 0
I20260807 22:51:48.051960 2492 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:48.055972 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 2398
W20260807 22:51:48.062258 2383 connection.cc:535] client connection to 127.0.0.1:38423 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38423): Connection reset by peer (error 104)
2026-08-07T22:51:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:48 dist-test-slave-tm1g krb5kdc[2503](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:48 dist-test-slave-tm1g krb5kdc[2503](info): set up 2 sockets
Aug 07 22:51:48 dist-test-slave-tm1g krb5kdc[2503](info): commencing operation
krb5kdc: starting...
W20260807 22:51:49.138070 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:49 dist-test-slave-tm1g krb5kdc[2503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:49.260842 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45719
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:49.371378 2516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:49.371619 2516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:49.371692 2516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:49.375573 2516 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:49.375622 2516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:49.375640 2516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:49.375686 2516 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:49.375720 2516 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:49.380841 2516 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:49.381794 2516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:49.382787 2516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:49.390946 2522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:49.390972 2521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:49.390950 2524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:49.391311 2516 server_base.cc:1034] running on GCE node
I20260807 22:51:49.391883 2516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:49.392845 2516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:49.394034 2516 hybrid_clock.cc:648] HybridClock initialized: now 1786143109394021 us; error 32 us; skew 500 ppm
Aug 07 22:51:49 dist-test-slave-tm1g krb5kdc[2503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143109, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:49.396736 2516 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:49.397521 2516 webserver.cc:460] Webserver started at http://127.0.0.1:42059/ using document root <none> and password file <none>
I20260807 22:51:49.398010 2516 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:49.398067 2516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:49.398224 2516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:49.400192 2516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "931f6512e3134d9983206809e529f7d3"
format_stamp: "Formatted at 2026-08-07 22:51:49 on dist-test-slave-tm1g"
server_key: "ec63ad66b7cdcfd2e1046f3e9b3ca567"
server_key_iv: "de2571889e7cba3b6437df89aed2232f"
server_key_version: "encryptionkey@0"
I20260807 22:51:49.400684 2516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "931f6512e3134d9983206809e529f7d3"
format_stamp: "Formatted at 2026-08-07 22:51:49 on dist-test-slave-tm1g"
server_key: "ec63ad66b7cdcfd2e1046f3e9b3ca567"
server_key_iv: "de2571889e7cba3b6437df89aed2232f"
server_key_version: "encryptionkey@0"
I20260807 22:51:49.404140 2516 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:51:49.406337 2531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:49.407497 2516 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:51:49.407590 2516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "931f6512e3134d9983206809e529f7d3"
format_stamp: "Formatted at 2026-08-07 22:51:49 on dist-test-slave-tm1g"
server_key: "ec63ad66b7cdcfd2e1046f3e9b3ca567"
server_key_iv: "de2571889e7cba3b6437df89aed2232f"
server_key_version: "encryptionkey@0"
I20260807 22:51:49.407668 2516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:49.416217 2516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:49.418843 2516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:49.418989 2516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:49.425693 2516 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45719
I20260807 22:51:49.425719 2588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45719 every 8 connection(s)
I20260807 22:51:49.426604 2516 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:49.427232 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 2516
I20260807 22:51:49.427373 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:49.427688 12739 external_mini_cluster.cc:1428] Setting key c649874c9de7e5f8cb2e4514b1168f4d
I20260807 22:51:49.429687 2589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:49.434945 2589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3: Bootstrap starting.
I20260807 22:51:49.436529 2592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:49.429044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:35621 (local address 127.0.0.1:45719)
0807 22:51:49.429506 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:49.429520 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:49.429555 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:51:49.430242 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:49.430258 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:49.430653 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:49.430991 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:49.431372 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:49.432335 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:49.433248 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:49.433712 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:49.433877 (+ 165us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:49.434874 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:49.434879 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:49.434891 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:49.435318 (+ 427us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:49.435371 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:49.435394 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:49.435537 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:49.435725 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 22:51:49.435856 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":147,"threads_started":1}
I20260807 22:51:49.437150 2589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:49.437989 2589 log.cc:824] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:49.439543 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:49.440043 2589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3: No bootstrap required, opened a new log
I20260807 22:51:49.444169 2589 raft_consensus.cc:348] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931f6512e3134d9983206809e529f7d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } }
I20260807 22:51:49.444459 2589 raft_consensus.cc:374] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:49.444536 2589 raft_consensus.cc:729] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931f6512e3134d9983206809e529f7d3, State: Initialized, Role: FOLLOWER
I20260807 22:51:49.445027 2589 consensus_queue.cc:260] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931f6512e3134d9983206809e529f7d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } }
I20260807 22:51:49.445225 2589 raft_consensus.cc:388] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:49.445318 2589 raft_consensus.cc:482] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:49.445437 2589 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:49.445647 2592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:49.441534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:46825 (local address 127.0.0.1:45719)
0807 22:51:49.441642 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:49.441646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:49.441804 (+ 158us) server_negotiation.cc:407] Connection header received
0807 22:51:49.441935 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:49.441937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:49.441972 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:49.442037 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:49.442397 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:49.442865 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:49.444001 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:49.444208 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:49.444280 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:49.445129 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:49.445132 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:49.445134 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:49.445144 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:49.445166 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:49.445176 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:49.445287 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:49.445466 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 22:51:49.445501 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:51:49.446528 2589 raft_consensus.cc:504] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931f6512e3134d9983206809e529f7d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } }
I20260807 22:51:49.446856 2589 leader_election.cc:302] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 931f6512e3134d9983206809e529f7d3; no voters:
I20260807 22:51:49.447184 2589 leader_election.cc:288] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:49.447247 2599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:49.447525 2599 raft_consensus.cc:686] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [term 1 LEADER]: Becoming Leader. State: Replica: 931f6512e3134d9983206809e529f7d3, State: Running, Role: LEADER
I20260807 22:51:49.447858 2599 consensus_queue.cc:237] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931f6512e3134d9983206809e529f7d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } }
I20260807 22:51:49.448370 2589 sys_catalog.cc:564] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:49.449457 2600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "931f6512e3134d9983206809e529f7d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931f6512e3134d9983206809e529f7d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } } }
I20260807 22:51:49.449601 2600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:49.449893 2601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 931f6512e3134d9983206809e529f7d3. Latest consensus state: current_term: 1 leader_uuid: "931f6512e3134d9983206809e529f7d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931f6512e3134d9983206809e529f7d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } } }
I20260807 22:51:49.450003 2601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:49.449983 2609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:49.453202 2609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:49.457976 2609 catalog_manager.cc:1347] Generated new cluster ID: 0bd9b80e9d9c44d999ecef9fca2acf1f
I20260807 22:51:49.458041 2609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:49.479350 2609 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:49.480261 2609 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:49.486487 2609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 931f6512e3134d9983206809e529f7d3: Generated new TSK 0
I20260807 22:51:49.487128 2609 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:49.494810 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 2516
W20260807 22:51:49.501940 2501 connection.cc:535] client connection to 127.0.0.1:45719 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45719): Connection reset by peer (error 104)
2026-08-07T22:51:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:49 dist-test-slave-tm1g krb5kdc[2621](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:49 dist-test-slave-tm1g krb5kdc[2621](info): set up 2 sockets
Aug 07 22:51:49 dist-test-slave-tm1g krb5kdc[2621](info): commencing operation
krb5kdc: starting...
W20260807 22:51:50.558264 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:50 dist-test-slave-tm1g krb5kdc[2621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143110, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:50.681584 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36507
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:50.791774 2634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:50.792029 2634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:50.792068 2634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:50.796011 2634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:50.796062 2634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:50.796082 2634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:50.796097 2634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:50.796113 2634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:50.801183 2634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:50.802119 2634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:50.803124 2634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:50.811748 2642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:50.811743 2640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:50.811759 2639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:50.811802 2634 server_base.cc:1034] running on GCE node
I20260807 22:51:50.812553 2634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:50.813699 2634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:50.814903 2634 hybrid_clock.cc:648] HybridClock initialized: now 1786143110814876 us; error 41 us; skew 500 ppm
W20260807 22:51:51.572364 2634 net_util.cc:504] Time spent look up canonical hostname for localhost 'dist-test-slave-tm1g': real 0.757s user 0.001s sys 0.000s
Aug 07 22:51:51 dist-test-slave-tm1g krb5kdc[2621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143111, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:51.574524 2634 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:51.575649 2634 webserver.cc:460] Webserver started at http://127.0.0.1:40805/ using document root <none> and password file <none>
I20260807 22:51:51.576249 2634 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:51.576344 2634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:51.576594 2634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:51.578727 2634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "6e9634afbf054ef9bb89c99e6ae4a533"
format_stamp: "Formatted at 2026-08-07 22:51:51 on dist-test-slave-tm1g"
server_key: "a0ee4766197cfd2e844b68bbb21a984d"
server_key_iv: "6f59047beee5aff28088599ce71cc3fe"
server_key_version: "encryptionkey@0"
I20260807 22:51:51.579308 2634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "6e9634afbf054ef9bb89c99e6ae4a533"
format_stamp: "Formatted at 2026-08-07 22:51:51 on dist-test-slave-tm1g"
server_key: "a0ee4766197cfd2e844b68bbb21a984d"
server_key_iv: "6f59047beee5aff28088599ce71cc3fe"
server_key_version: "encryptionkey@0"
I20260807 22:51:51.583077 2634 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:51:51.585415 2649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:51.586747 2634 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:51:51.586900 2634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "6e9634afbf054ef9bb89c99e6ae4a533"
format_stamp: "Formatted at 2026-08-07 22:51:51 on dist-test-slave-tm1g"
server_key: "a0ee4766197cfd2e844b68bbb21a984d"
server_key_iv: "6f59047beee5aff28088599ce71cc3fe"
server_key_version: "encryptionkey@0"
I20260807 22:51:51.586988 2634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:51.591457 2634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:51.594167 2634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:51.594377 2634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:51.601307 2634 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36507
I20260807 22:51:51.601362 2704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36507 every 8 connection(s)
I20260807 22:51:51.602182 2634 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:51.604825 2705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:51.609753 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 2634
I20260807 22:51:51.609902 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:51.610208 12739 external_mini_cluster.cc:1428] Setting key 8ac46d4c3356d704ae6142919830b267
I20260807 22:51:51.610293 2705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533: Bootstrap starting.
I20260807 22:51:51.612727 2705 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:51.613451 2705 log.cc:824] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:51.615366 2708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:51.611602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:59513 (local address 127.0.0.1:36507)
0807 22:51:51.612024 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:51.612042 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:51.612077 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:51:51.612664 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:51.612680 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:51.613003 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:51.613338 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:51.614065 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:51.614071 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:51.614086 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:51.614098 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:51.614161 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:51.614193 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:51.614353 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:51.614506 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 22:51:51.614679 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":104,"threads_started":1}
I20260807 22:51:51.615702 2705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533: No bootstrap required, opened a new log
I20260807 22:51:51.618198 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:51.620131 2705 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e9634afbf054ef9bb89c99e6ae4a533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36507 } }
I20260807 22:51:51.620414 2705 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:51.620484 2705 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e9634afbf054ef9bb89c99e6ae4a533, State: Initialized, Role: FOLLOWER
I20260807 22:51:51.620982 2705 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e9634afbf054ef9bb89c99e6ae4a533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36507 } }
I20260807 22:51:51.621145 2705 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:51.621222 2705 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:51.621333 2705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:51.622282 2708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:51.620663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:51299 (local address 127.0.0.1:36507)
0807 22:51:51.620783 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:51.620787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:51.620996 (+ 209us) server_negotiation.cc:407] Connection header received
0807 22:51:51.621069 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:51.621071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:51.621106 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:51.621189 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:51.621897 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:51.621899 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:51.621901 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:51.621911 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:51.621934 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:51.621944 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:51.622011 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:51.622125 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 22:51:51.622155 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:51:51.622576 2705 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e9634afbf054ef9bb89c99e6ae4a533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36507 } }
I20260807 22:51:51.622928 2705 leader_election.cc:302] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e9634afbf054ef9bb89c99e6ae4a533; no voters:
I20260807 22:51:51.623278 2705 leader_election.cc:288] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:51.623409 2715 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:51.623658 2715 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [term 1 LEADER]: Becoming Leader. State: Replica: 6e9634afbf054ef9bb89c99e6ae4a533, State: Running, Role: LEADER
I20260807 22:51:51.623994 2715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e9634afbf054ef9bb89c99e6ae4a533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36507 } }
I20260807 22:51:51.624475 2705 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:51.625659 2717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e9634afbf054ef9bb89c99e6ae4a533. Latest consensus state: current_term: 1 leader_uuid: "6e9634afbf054ef9bb89c99e6ae4a533" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e9634afbf054ef9bb89c99e6ae4a533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36507 } } }
I20260807 22:51:51.625792 2717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:51.626166 2725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:51.626133 2716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e9634afbf054ef9bb89c99e6ae4a533" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e9634afbf054ef9bb89c99e6ae4a533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36507 } } }
I20260807 22:51:51.626560 2716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:51.628872 2725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:51.634172 2725 catalog_manager.cc:1347] Generated new cluster ID: c4a41809ba404827950c7ecad66dc169
I20260807 22:51:51.634236 2725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:51.654173 2725 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:51.654542 2725 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:51.658747 2725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e9634afbf054ef9bb89c99e6ae4a533: Generated new TSK 0
I20260807 22:51:51.659363 2725 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:51.665694 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 2634
2026-08-07T22:51:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2170 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:51 dist-test-slave-tm1g krb5kdc[2737](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:51 dist-test-slave-tm1g krb5kdc[2737](info): set up 2 sockets
Aug 07 22:51:51 dist-test-slave-tm1g krb5kdc[2737](info): commencing operation
krb5kdc: starting...
W20260807 22:51:52.722259 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:52 dist-test-slave-tm1g krb5kdc[2737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:52.845216 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33579
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:52.953877 2751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:52.954125 2751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:52.954165 2751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:52.958021 2751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:52.958076 2751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:52.958093 2751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:52.958109 2751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:52.958124 2751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:52.963212 2751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33579
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:52.964144 2751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:52.965080 2751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:52.973528 2757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:52.973522 2758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:52.973577 2751 server_base.cc:1034] running on GCE node
W20260807 22:51:52.973522 2760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:52.974255 2751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:52.975356 2751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:52.976545 2751 hybrid_clock.cc:648] HybridClock initialized: now 1786143112976528 us; error 29 us; skew 500 ppm
Aug 07 22:51:52 dist-test-slave-tm1g krb5kdc[2737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143112, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:52.979214 2751 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:52.980041 2751 webserver.cc:460] Webserver started at http://127.0.0.1:40601/ using document root <none> and password file <none>
I20260807 22:51:52.980582 2751 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:52.980671 2751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:52.980899 2751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:52.982967 2751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "5af2d06d0c4f47d4a726f079bb2fa89a"
format_stamp: "Formatted at 2026-08-07 22:51:52 on dist-test-slave-tm1g"
server_key: "f4256b39f301578c6ddf239a8e0db561"
server_key_iv: "f7a87709f0464585d681f55a58fa1326"
server_key_version: "encryptionkey@0"
I20260807 22:51:52.983525 2751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "5af2d06d0c4f47d4a726f079bb2fa89a"
format_stamp: "Formatted at 2026-08-07 22:51:52 on dist-test-slave-tm1g"
server_key: "f4256b39f301578c6ddf239a8e0db561"
server_key_iv: "f7a87709f0464585d681f55a58fa1326"
server_key_version: "encryptionkey@0"
I20260807 22:51:52.987439 2751 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260807 22:51:52.989847 2767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:52.991124 2751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:51:52.991274 2751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "5af2d06d0c4f47d4a726f079bb2fa89a"
format_stamp: "Formatted at 2026-08-07 22:51:52 on dist-test-slave-tm1g"
server_key: "f4256b39f301578c6ddf239a8e0db561"
server_key_iv: "f7a87709f0464585d681f55a58fa1326"
server_key_version: "encryptionkey@0"
I20260807 22:51:52.991400 2751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:53.004653 2751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:53.007400 2751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:53.007606 2751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:53.014464 2751 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33579
I20260807 22:51:53.014484 2821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33579 every 8 connection(s)
I20260807 22:51:53.015388 2751 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:53.018035 2822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:53.021124 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 2751
I20260807 22:51:53.021293 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:53.021584 12739 external_mini_cluster.cc:1428] Setting key de0f4113d92b7da647f509b0a4279f4b
I20260807 22:51:53.023881 2822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a: Bootstrap starting.
I20260807 22:51:53.026006 2822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:53.026785 2822 log.cc:824] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:53.028641 2822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a: No bootstrap required, opened a new log
Aug 07 22:51:53 dist-test-slave-tm1g krb5kdc[2737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:51:53.032883 2822 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af2d06d0c4f47d4a726f079bb2fa89a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33579 } }
I20260807 22:51:53.033154 2822 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:53.033222 2822 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af2d06d0c4f47d4a726f079bb2fa89a, State: Initialized, Role: FOLLOWER
I20260807 22:51:53.033681 2822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af2d06d0c4f47d4a726f079bb2fa89a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33579 } }
I20260807 22:51:53.033849 2822 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:53.033936 2822 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:53.034054 2822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:53.035225 2822 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af2d06d0c4f47d4a726f079bb2fa89a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33579 } }
I20260807 22:51:53.035575 2822 leader_election.cc:302] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5af2d06d0c4f47d4a726f079bb2fa89a; no voters:
I20260807 22:51:53.035907 2822 leader_election.cc:288] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:53.036000 2828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:53.036224 2828 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [term 1 LEADER]: Becoming Leader. State: Replica: 5af2d06d0c4f47d4a726f079bb2fa89a, State: Running, Role: LEADER
I20260807 22:51:53.036298 2826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:53.022921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:45781 (local address 127.0.0.1:33579)
0807 22:51:53.023329 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:53.023343 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:53.023380 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:51:53.024164 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:53.024183 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:53.024510 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:53.024823 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:53.025663 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:53.026769 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:53.027637 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:53.028107 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:53.028285 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:53.031193 (+ 2908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:53.031199 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:53.031212 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:53.031239 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:53.032958 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:53.033557 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:53.033563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:53.033568 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:53.033690 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:53.034072 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:53.034075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:53.034077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:53.034585 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:53.034761 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:53.035076 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 22:51:53.035302 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":116,"threads_started":1}
I20260807 22:51:53.036996 2828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af2d06d0c4f47d4a726f079bb2fa89a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33579 } }
I20260807 22:51:53.037199 2822 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:53.039060 2829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5af2d06d0c4f47d4a726f079bb2fa89a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af2d06d0c4f47d4a726f079bb2fa89a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33579 } } }
I20260807 22:51:53.039132 2830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5af2d06d0c4f47d4a726f079bb2fa89a. Latest consensus state: current_term: 1 leader_uuid: "5af2d06d0c4f47d4a726f079bb2fa89a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af2d06d0c4f47d4a726f079bb2fa89a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33579 } } }
I20260807 22:51:53.039270 2830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:53.039201 2829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:53.040112 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 22:51:53.042444 2843 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:51:53.042553 2843 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:51:53.042624 2844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:53.043449 2844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:53.049113 2844 catalog_manager.cc:1347] Generated new cluster ID: c9a2e23e1cf44d47aecff59cba7b3ef4
I20260807 22:51:53.049167 2844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:53.052986 2826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:53.042300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:42305 (local address 127.0.0.1:33579)
0807 22:51:53.042436 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:53.042441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:53.042688 (+ 247us) server_negotiation.cc:407] Connection header received
0807 22:51:53.042876 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:53.042880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:53.042929 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:53.043014 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:53.043860 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:53.044615 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:53.045812 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:53.046139 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:53.046248 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:53.048041 (+ 1793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:53.048044 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:53.048047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:53.048071 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:53.051014 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:53.051576 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:53.051579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:53.051581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:53.051662 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:53.052014 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:53.052017 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:53.052019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:53.052225 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:53.052364 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:53.052725 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 22:51:53.052837 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:51:53.057317 2844 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:53.058177 2844 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:53.070336 2844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5af2d06d0c4f47d4a726f079bb2fa89a: Generated new TSK 0
I20260807 22:51:53.071178 2844 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:53.082998 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 2751
W20260807 22:51:53.090746 2735 connection.cc:535] client connection to 127.0.0.1:33579 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33579): Connection reset by peer (error 104)
2026-08-07T22:51:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1418 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:53 dist-test-slave-tm1g krb5kdc[2855](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:53 dist-test-slave-tm1g krb5kdc[2855](info): set up 2 sockets
Aug 07 22:51:53 dist-test-slave-tm1g krb5kdc[2855](info): commencing operation
krb5kdc: starting...
W20260807 22:51:54.141621 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:54 dist-test-slave-tm1g krb5kdc[2855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:54.261744 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36619
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36619
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:54.370889 2870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:54.371158 2870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:54.371237 2870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:54.375168 2870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:54.375250 2870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:54.375293 2870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:54.375355 2870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:54.375394 2870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:54.380524 2870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36619
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:54.381493 2870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:54.382488 2870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:54.390627 2875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:54.390659 2876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:54.390671 2878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:54.390978 2870 server_base.cc:1034] running on GCE node
I20260807 22:51:54.391569 2870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:54.392601 2870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:54.393822 2870 hybrid_clock.cc:648] HybridClock initialized: now 1786143114393806 us; error 34 us; skew 500 ppm
Aug 07 22:51:54 dist-test-slave-tm1g krb5kdc[2855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143114, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:54.396538 2870 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:54.397385 2870 webserver.cc:460] Webserver started at http://127.0.0.1:45509/ using document root <none> and password file <none>
I20260807 22:51:54.397931 2870 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:54.398020 2870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:54.398245 2870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:54.400210 2870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "580cf8fe42274f119a2ac5ac99a829d9"
format_stamp: "Formatted at 2026-08-07 22:51:54 on dist-test-slave-tm1g"
server_key: "25b2332225dbd4fa63904851b678dee2"
server_key_iv: "d96650b3d013543e14bdc319e899b045"
server_key_version: "encryptionkey@0"
I20260807 22:51:54.400756 2870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "580cf8fe42274f119a2ac5ac99a829d9"
format_stamp: "Formatted at 2026-08-07 22:51:54 on dist-test-slave-tm1g"
server_key: "25b2332225dbd4fa63904851b678dee2"
server_key_iv: "d96650b3d013543e14bdc319e899b045"
server_key_version: "encryptionkey@0"
I20260807 22:51:54.404248 2870 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:51:54.406527 2885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:54.407646 2870 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:51:54.407786 2870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "580cf8fe42274f119a2ac5ac99a829d9"
format_stamp: "Formatted at 2026-08-07 22:51:54 on dist-test-slave-tm1g"
server_key: "25b2332225dbd4fa63904851b678dee2"
server_key_iv: "d96650b3d013543e14bdc319e899b045"
server_key_version: "encryptionkey@0"
I20260807 22:51:54.407891 2870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:54.426896 2870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:54.429585 2870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:54.429775 2870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:54.436540 2870 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36619
I20260807 22:51:54.436566 2939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36619 every 8 connection(s)
I20260807 22:51:54.437469 2870 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:54.440016 2940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:54.445276 2940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9: Bootstrap starting.
I20260807 22:51:54.447579 2940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:54.447585 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 2870
I20260807 22:51:54.447762 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:54.448041 12739 external_mini_cluster.cc:1428] Setting key 0f9819080ff1fed049ba627b9c52f4c8
I20260807 22:51:54.448392 2940 log.cc:824] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:54.450464 2940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9: No bootstrap required, opened a new log
I20260807 22:51:54.453683 2940 raft_consensus.cc:348] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580cf8fe42274f119a2ac5ac99a829d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36619 } }
I20260807 22:51:54.453907 2940 raft_consensus.cc:374] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:54.453974 2940 raft_consensus.cc:729] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 580cf8fe42274f119a2ac5ac99a829d9, State: Initialized, Role: FOLLOWER
I20260807 22:51:54.454468 2940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580cf8fe42274f119a2ac5ac99a829d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36619 } }
I20260807 22:51:54.454614 2940 raft_consensus.cc:388] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:54.454687 2940 raft_consensus.cc:482] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:54.454805 2940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:54.455642 2940 raft_consensus.cc:504] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580cf8fe42274f119a2ac5ac99a829d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36619 } }
I20260807 22:51:54.455963 2940 leader_election.cc:302] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 580cf8fe42274f119a2ac5ac99a829d9; no voters:
I20260807 22:51:54.456264 2940 leader_election.cc:288] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:54.456365 2945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:54.456563 2945 raft_consensus.cc:686] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [term 1 LEADER]: Becoming Leader. State: Replica: 580cf8fe42274f119a2ac5ac99a829d9, State: Running, Role: LEADER
I20260807 22:51:54.456653 2944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:54.449133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:38971 (local address 127.0.0.1:36619)
0807 22:51:54.449527 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:54.449541 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:54.449574 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:51:54.450168 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:54.450184 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:54.450604 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:54.450921 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:54.451318 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:54.452251 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:54.453140 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:54.453603 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:54.453775 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:54.454705 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:54.454711 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:54.454725 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:54.455184 (+ 459us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:54.455233 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:54.455255 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:54.455394 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:54.455574 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 22:51:54.455697 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":128,"threads_started":1}
I20260807 22:51:54.456907 2945 consensus_queue.cc:237] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580cf8fe42274f119a2ac5ac99a829d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36619 } }
I20260807 22:51:54.457459 2940 sys_catalog.cc:564] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:54.457993 2945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 580cf8fe42274f119a2ac5ac99a829d9. Latest consensus state: current_term: 1 leader_uuid: "580cf8fe42274f119a2ac5ac99a829d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580cf8fe42274f119a2ac5ac99a829d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36619 } } }
I20260807 22:51:54.458153 2945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:54.458472 2946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "580cf8fe42274f119a2ac5ac99a829d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580cf8fe42274f119a2ac5ac99a829d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36619 } } }
I20260807 22:51:54.458639 2946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:54.458583 2952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:54.459844 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:54.461757 2952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:54.467342 2952 catalog_manager.cc:1347] Generated new cluster ID: 23c30abe50a6499c8b11cdd48458ad75
I20260807 22:51:54.467401 2952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:54.468042 2944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:54.462023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:53023 (local address 127.0.0.1:36619)
0807 22:51:54.462348 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:54.462352 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:54.464148 (+ 1796us) server_negotiation.cc:407] Connection header received
0807 22:51:54.464250 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:54.464252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:54.464296 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:54.464376 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:54.464673 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:54.465420 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:54.466425 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:54.466680 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:54.466801 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:54.467591 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:54.467595 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:54.467597 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:54.467609 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:54.467633 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:54.467652 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:54.467749 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:54.467869 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 22:51:54.467900 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238}
I20260807 22:51:54.493253 2952 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:54.494561 2952 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:54.502257 2952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 580cf8fe42274f119a2ac5ac99a829d9: Generated new TSK 0
I20260807 22:51:54.502894 2952 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:54.512312 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 2870
W20260807 22:51:54.519768 2853 connection.cc:535] client connection to 127.0.0.1:36619 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36619): Connection reset by peer (error 104)
2026-08-07T22:51:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1428 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:54 dist-test-slave-tm1g krb5kdc[2973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:54 dist-test-slave-tm1g krb5kdc[2973](info): set up 2 sockets
Aug 07 22:51:54 dist-test-slave-tm1g krb5kdc[2973](info): commencing operation
krb5kdc: starting...
W20260807 22:51:55.573871 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:55 dist-test-slave-tm1g krb5kdc[2973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:51:55.693461 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44233
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:55.803448 2986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:55.803720 2986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:55.803797 2986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:55.807714 2986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:55.807801 2986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:55.807840 2986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:55.807896 2986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:55.807953 2986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:55.812952 2986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44233
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:55.813925 2986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:55.814915 2986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:55.823046 2994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:55.823046 2992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:55.823078 2991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:55.823081 2986 server_base.cc:1034] running on GCE node
I20260807 22:51:55.823747 2986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:55.824687 2986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:55.825874 2986 hybrid_clock.cc:648] HybridClock initialized: now 1786143115825845 us; error 48 us; skew 500 ppm
Aug 07 22:51:55 dist-test-slave-tm1g krb5kdc[2973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143115, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:55.828617 2986 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:51:55.829450 2986 webserver.cc:460] Webserver started at http://127.0.0.1:42387/ using document root <none> and password file <none>
I20260807 22:51:55.829977 2986 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:55.830068 2986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:55.830289 2986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:55.832305 2986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "c1cfe86061ca43d7b73148f59eed0ee6"
format_stamp: "Formatted at 2026-08-07 22:51:55 on dist-test-slave-tm1g"
server_key: "688f415073f4deaf1df6790ebb349fd4"
server_key_iv: "8f476e80b9157d5d467dbda506bffd19"
server_key_version: "encryptionkey@0"
I20260807 22:51:55.832846 2986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "c1cfe86061ca43d7b73148f59eed0ee6"
format_stamp: "Formatted at 2026-08-07 22:51:55 on dist-test-slave-tm1g"
server_key: "688f415073f4deaf1df6790ebb349fd4"
server_key_iv: "8f476e80b9157d5d467dbda506bffd19"
server_key_version: "encryptionkey@0"
I20260807 22:51:55.836432 2986 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 22:51:55.838940 3002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:55.840049 2986 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:55.840184 2986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "c1cfe86061ca43d7b73148f59eed0ee6"
format_stamp: "Formatted at 2026-08-07 22:51:55 on dist-test-slave-tm1g"
server_key: "688f415073f4deaf1df6790ebb349fd4"
server_key_iv: "8f476e80b9157d5d467dbda506bffd19"
server_key_version: "encryptionkey@0"
I20260807 22:51:55.840289 2986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:55.844779 2986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:55.847951 2986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:55.848145 2986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:55.855283 2986 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44233
I20260807 22:51:55.855293 3057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44233 every 8 connection(s)
I20260807 22:51:55.856143 2986 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:55.858702 3058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:55.859014 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 2986
I20260807 22:51:55.859155 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:55.859472 12739 external_mini_cluster.cc:1428] Setting key 42a56b7a59def48537dc5324911eb5fe
I20260807 22:51:55.864218 3061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:55.860696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:45909 (local address 127.0.0.1:44233)
0807 22:51:55.861094 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:55.861107 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:55.861140 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:51:55.861822 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:55.861837 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:55.862088 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:55.862405 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:55.863110 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:55.863115 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:55.863125 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:55.863135 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:55.863180 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:55.863197 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:55.863325 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:55.863433 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 22:51:55.863592 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":137,"threads_started":1}
I20260807 22:51:55.865170 3058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6: Bootstrap starting.
I20260807 22:51:55.866863 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:55.867502 3058 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:55.868367 3058 log.cc:824] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:55.870648 3058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6: No bootstrap required, opened a new log
I20260807 22:51:55.870807 3061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:55.869139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:40651 (local address 127.0.0.1:44233)
0807 22:51:55.869267 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:55.869271 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:55.869488 (+ 217us) server_negotiation.cc:407] Connection header received
0807 22:51:55.869601 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:55.869603 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:55.869631 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:55.869693 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:55.870338 (+ 645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:55.870345 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:55.870351 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:55.870367 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:55.870397 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:55.870408 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:55.870475 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:55.870603 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 22:51:55.870635 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:51:55.873999 3058 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cfe86061ca43d7b73148f59eed0ee6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260807 22:51:55.874222 3058 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:55.874281 3058 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1cfe86061ca43d7b73148f59eed0ee6, State: Initialized, Role: FOLLOWER
I20260807 22:51:55.874719 3058 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cfe86061ca43d7b73148f59eed0ee6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260807 22:51:55.874866 3058 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:55.874931 3058 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:55.875031 3058 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:55.875852 3058 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cfe86061ca43d7b73148f59eed0ee6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260807 22:51:55.876173 3058 leader_election.cc:302] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1cfe86061ca43d7b73148f59eed0ee6; no voters:
I20260807 22:51:55.876454 3058 leader_election.cc:288] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:55.876581 3068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:55.876835 3068 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [term 1 LEADER]: Becoming Leader. State: Replica: c1cfe86061ca43d7b73148f59eed0ee6, State: Running, Role: LEADER
I20260807 22:51:55.877190 3068 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cfe86061ca43d7b73148f59eed0ee6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260807 22:51:55.877704 3058 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:55.878933 3070 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1cfe86061ca43d7b73148f59eed0ee6. Latest consensus state: current_term: 1 leader_uuid: "c1cfe86061ca43d7b73148f59eed0ee6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cfe86061ca43d7b73148f59eed0ee6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } } }
I20260807 22:51:55.879048 3070 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:55.878993 3069 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1cfe86061ca43d7b73148f59eed0ee6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cfe86061ca43d7b73148f59eed0ee6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } } }
I20260807 22:51:55.879194 3069 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:55.879474 3077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:55.882453 3077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:55.887763 3077 catalog_manager.cc:1347] Generated new cluster ID: 9ec6a7bfff6c4686b597d6f6b8630731
I20260807 22:51:55.887830 3077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:55.909595 3077 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:55.909871 3077 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:55.915584 3077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1cfe86061ca43d7b73148f59eed0ee6: Generated new TSK 0
I20260807 22:51:55.916263 3077 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:55.926731 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 2986
2026-08-07T22:51:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1413 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:55 dist-test-slave-tm1g krb5kdc[3090](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:55 dist-test-slave-tm1g krb5kdc[3090](info): set up 2 sockets
Aug 07 22:51:55 dist-test-slave-tm1g krb5kdc[3090](info): commencing operation
krb5kdc: starting...
W20260807 22:51:56.974980 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:57 dist-test-slave-tm1g krb5kdc[3090](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:51:57.093150 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:35433
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:35433
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:57.200752 3103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:57.201002 3103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:57.201042 3103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:57.204880 3103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:57.204926 3103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:57.204944 3103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:57.204960 3103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:57.204974 3103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:57.209913 3103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:35433
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:35433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:57.210862 3103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:57.211769 3103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:57.220074 3109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:57.220149 3111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:57.220052 3108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:57.220274 3103 server_base.cc:1034] running on GCE node
I20260807 22:51:57.220819 3103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:57.221858 3103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:57.223042 3103 hybrid_clock.cc:648] HybridClock initialized: now 1786143117223016 us; error 40 us; skew 500 ppm
Aug 07 22:51:57 dist-test-slave-tm1g krb5kdc[3090](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143117, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:57.230578 3103 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:51:57.231338 3103 webserver.cc:460] Webserver started at http://127.12.112.254:44223/ using document root <none> and password file <none>
I20260807 22:51:57.231829 3103 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:57.231884 3103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:57.232039 3103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:57.234092 3103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "737d8333d2e84de588f7aaf80690a21f"
format_stamp: "Formatted at 2026-08-07 22:51:57 on dist-test-slave-tm1g"
server_key: "b87efc3dc36eb9ea1f52d669cd063cc4"
server_key_iv: "bfc9272c47745a0cb3b0fbc214a4c8d7"
server_key_version: "encryptionkey@0"
I20260807 22:51:57.234678 3103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "737d8333d2e84de588f7aaf80690a21f"
format_stamp: "Formatted at 2026-08-07 22:51:57 on dist-test-slave-tm1g"
server_key: "b87efc3dc36eb9ea1f52d669cd063cc4"
server_key_iv: "bfc9272c47745a0cb3b0fbc214a4c8d7"
server_key_version: "encryptionkey@0"
I20260807 22:51:57.238039 3103 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:51:57.240361 3118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:57.241515 3103 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:51:57.241608 3103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "737d8333d2e84de588f7aaf80690a21f"
format_stamp: "Formatted at 2026-08-07 22:51:57 on dist-test-slave-tm1g"
server_key: "b87efc3dc36eb9ea1f52d669cd063cc4"
server_key_iv: "bfc9272c47745a0cb3b0fbc214a4c8d7"
server_key_version: "encryptionkey@0"
I20260807 22:51:57.241685 3103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:57.252676 3103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:57.255417 3103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:57.255563 3103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:57.262501 3103 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:35433
I20260807 22:51:57.262521 3173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:35433 every 8 connection(s)
I20260807 22:51:57.263412 3103 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:57.265942 3174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:57.268978 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 3103
I20260807 22:51:57.269119 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:57.269389 12739 external_mini_cluster.cc:1428] Setting key 9254d617e94493c03578fc43e72c16ee
I20260807 22:51:57.271742 3174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f: Bootstrap starting.
I20260807 22:51:57.274314 3174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:57.275151 3174 log.cc:824] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:57.277230 3174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f: No bootstrap required, opened a new log
Aug 07 22:51:57 dist-test-slave-tm1g krb5kdc[3090](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:51:57.281172 3174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737d8333d2e84de588f7aaf80690a21f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 35433 } }
I20260807 22:51:57.281447 3174 raft_consensus.cc:374] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:57.281497 3174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737d8333d2e84de588f7aaf80690a21f, State: Initialized, Role: FOLLOWER
I20260807 22:51:57.281949 3174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737d8333d2e84de588f7aaf80690a21f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 35433 } }
I20260807 22:51:57.282121 3174 raft_consensus.cc:388] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:57.282202 3174 raft_consensus.cc:482] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:57.282334 3174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:57.283475 3174 raft_consensus.cc:504] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737d8333d2e84de588f7aaf80690a21f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 35433 } }
I20260807 22:51:57.283806 3174 leader_election.cc:302] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 737d8333d2e84de588f7aaf80690a21f; no voters:
I20260807 22:51:57.284118 3174 leader_election.cc:288] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:57.284252 3179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:57.284466 3179 raft_consensus.cc:686] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [term 1 LEADER]: Becoming Leader. State: Replica: 737d8333d2e84de588f7aaf80690a21f, State: Running, Role: LEADER
I20260807 22:51:57.284770 3179 consensus_queue.cc:237] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737d8333d2e84de588f7aaf80690a21f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 35433 } }
I20260807 22:51:57.285369 3174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:57.285518 3177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:57.270743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59127 (local address 127.12.112.254:35433)
0807 22:51:57.271147 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:57.271165 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:57.271204 (+ 39us) server_negotiation.cc:407] Connection header received
0807 22:51:57.272002 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:57.272025 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:57.272411 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:57.272738 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:57.273415 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:57.274976 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:57.276055 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:57.276709 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:57.276869 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:57.279544 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:57.279550 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:57.279565 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:57.279595 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:57.282028 (+ 2433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:57.282729 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:57.282735 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:57.282740 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:57.282880 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:57.283200 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:57.283204 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:57.283206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:57.283703 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:57.283931 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:57.284381 (+ 450us) server_negotiation.cc:299] Negotiation successful
0807 22:51:57.284609 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":106,"threads_started":1}
I20260807 22:51:57.285811 3179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 737d8333d2e84de588f7aaf80690a21f. Latest consensus state: current_term: 1 leader_uuid: "737d8333d2e84de588f7aaf80690a21f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737d8333d2e84de588f7aaf80690a21f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 35433 } } }
I20260807 22:51:57.285926 3179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:57.286350 3183 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:57.287287 3180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "737d8333d2e84de588f7aaf80690a21f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737d8333d2e84de588f7aaf80690a21f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 35433 } } }
I20260807 22:51:57.287446 3180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:57.288712 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:57.289383 3183 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:57.295051 3183 catalog_manager.cc:1347] Generated new cluster ID: fcc888f054714b2a8884bbe1870b2f16
I20260807 22:51:57.295156 3183 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:57.299149 3177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:57.291102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44727 (local address 127.12.112.254:35433)
0807 22:51:57.291202 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:57.291206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:57.291576 (+ 370us) server_negotiation.cc:407] Connection header received
0807 22:51:57.291719 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:57.291722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:57.291769 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:57.291854 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:57.292453 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:57.292957 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:57.294014 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:57.294456 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:57.294567 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:57.295976 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:57.295978 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:57.295981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:51:57.296000 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:57.297365 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:57.297832 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:57.297836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:57.297842 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:57.297911 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:51:57.298248 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:51:57.298251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:51:57.298253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:51:57.298468 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:57.298615 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:57.298878 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 22:51:57.298972 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":40}
I20260807 22:51:57.315822 3183 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:57.316785 3183 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:57.324407 3183 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 737d8333d2e84de588f7aaf80690a21f: Generated new TSK 0
I20260807 22:51:57.325074 3183 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:57.335938 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 3103
W20260807 22:51:57.343087 3088 connection.cc:535] client connection to 127.12.112.254:35433 recv error: Network error: failed to read from TLS socket (remote: 127.12.112.254:35433): Connection reset by peer (error 104)
2026-08-07T22:51:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:57 dist-test-slave-tm1g krb5kdc[3205](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:57 dist-test-slave-tm1g krb5kdc[3205](info): set up 2 sockets
Aug 07 22:51:57 dist-test-slave-tm1g krb5kdc[3205](info): commencing operation
krb5kdc: starting...
W20260807 22:51:58.406831 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:58 dist-test-slave-tm1g krb5kdc[3205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:51:58.551645 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:45029
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:45029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:51:58.659590 3219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:51:58.659824 3219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:51:58.659863 3219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:51:58.663681 3219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:51:58.663726 3219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:51:58.663744 3219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:51:58.663759 3219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:51:58.663774 3219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:51:58.668818 3219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:45029
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:45029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:51:58.669724 3219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:51:58.670637 3219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:51:58.678781 3228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:58.678839 3226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:51:58.678786 3225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:51:58.679032 3219 server_base.cc:1034] running on GCE node
I20260807 22:51:58.679565 3219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:51:58.680584 3219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:51:58.681804 3219 hybrid_clock.cc:648] HybridClock initialized: now 1786143118681774 us; error 43 us; skew 500 ppm
Aug 07 22:51:58 dist-test-slave-tm1g krb5kdc[3205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143118, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:51:58.684590 3219 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:51:58.685439 3219 webserver.cc:460] Webserver started at http://127.12.112.254:41437/ using document root <none> and password file <none>
I20260807 22:51:58.685930 3219 fs_manager.cc:359] Metadata directory not provided
I20260807 22:51:58.685986 3219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:51:58.686143 3219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:51:58.688093 3219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "804004c5f2cf4c10acdee7c4c34d74d5"
format_stamp: "Formatted at 2026-08-07 22:51:58 on dist-test-slave-tm1g"
server_key: "69301ffd214da927beb457baefaa2d44"
server_key_iv: "0ba2811d064f5e482f05c7fc12e9ab8d"
server_key_version: "encryptionkey@0"
I20260807 22:51:58.688607 3219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "804004c5f2cf4c10acdee7c4c34d74d5"
format_stamp: "Formatted at 2026-08-07 22:51:58 on dist-test-slave-tm1g"
server_key: "69301ffd214da927beb457baefaa2d44"
server_key_iv: "0ba2811d064f5e482f05c7fc12e9ab8d"
server_key_version: "encryptionkey@0"
I20260807 22:51:58.692162 3219 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260807 22:51:58.694473 3235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:51:58.695680 3219 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:51:58.695801 3219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "804004c5f2cf4c10acdee7c4c34d74d5"
format_stamp: "Formatted at 2026-08-07 22:51:58 on dist-test-slave-tm1g"
server_key: "69301ffd214da927beb457baefaa2d44"
server_key_iv: "0ba2811d064f5e482f05c7fc12e9ab8d"
server_key_version: "encryptionkey@0"
I20260807 22:51:58.695888 3219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:51:58.713217 3219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:51:58.716459 3219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:51:58.716614 3219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:51:58.724054 3219 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:45029
I20260807 22:51:58.724079 3289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:45029 every 8 connection(s)
I20260807 22:51:58.725025 3219 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:51:58.727802 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 3219
I20260807 22:51:58.727867 3290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:51:58.727965 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:51:58.728323 12739 external_mini_cluster.cc:1428] Setting key 431a35d70b67830d949e7d90c580076e
I20260807 22:51:58.734503 3290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5: Bootstrap starting.
I20260807 22:51:58.736642 3290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5: Neither blocks nor log segments found. Creating new log.
I20260807 22:51:58.737478 3290 log.cc:824] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:51:58.737712 3294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:58.729890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57571 (local address 127.12.112.254:45029)
0807 22:51:58.730422 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:58.730438 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:58.730475 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:51:58.731292 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:58.731311 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:58.731638 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:58.731967 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:58.732369 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:58.733360 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:58.734292 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:58.734849 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:58.735025 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:58.735959 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:58.735963 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:58.735976 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:58.736362 (+ 386us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:58.736416 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:58.736438 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:58.736583 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:58.736738 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 22:51:58.736886 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":148,"threads_started":1}
I20260807 22:51:58.739694 3290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5: No bootstrap required, opened a new log
I20260807 22:51:58.740902 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:51:58.744305 3290 raft_consensus.cc:348] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804004c5f2cf4c10acdee7c4c34d74d5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45029 } }
I20260807 22:51:58.744525 3290 raft_consensus.cc:374] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:51:58.744592 3290 raft_consensus.cc:729] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 804004c5f2cf4c10acdee7c4c34d74d5, State: Initialized, Role: FOLLOWER
I20260807 22:51:58.745064 3290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804004c5f2cf4c10acdee7c4c34d74d5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45029 } }
I20260807 22:51:58.745229 3290 raft_consensus.cc:388] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:51:58.745306 3290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:51:58.745398 3290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:51:58.746516 3290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804004c5f2cf4c10acdee7c4c34d74d5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45029 } }
I20260807 22:51:58.746908 3290 leader_election.cc:302] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 804004c5f2cf4c10acdee7c4c34d74d5; no voters:
I20260807 22:51:58.747303 3290 leader_election.cc:288] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:51:58.747376 3301 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:51:58.747593 3301 raft_consensus.cc:686] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [term 1 LEADER]: Becoming Leader. State: Replica: 804004c5f2cf4c10acdee7c4c34d74d5, State: Running, Role: LEADER
I20260807 22:51:58.747759 3294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:51:58.743219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60473 (local address 127.12.112.254:45029)
0807 22:51:58.743374 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:51:58.743380 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:51:58.743550 (+ 170us) server_negotiation.cc:407] Connection header received
0807 22:51:58.743666 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:51:58.743668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:51:58.743704 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:51:58.743770 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:51:58.744104 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:58.744741 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:58.745861 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:51:58.746122 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:51:58.746208 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:51:58.747178 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:51:58.747182 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:51:58.747185 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:51:58.747197 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:51:58.747220 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:51:58.747231 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:51:58.747344 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 22:51:58.747517 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 22:51:58.747552 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:51:58.748220 3301 consensus_queue.cc:237] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804004c5f2cf4c10acdee7c4c34d74d5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45029 } }
I20260807 22:51:58.748636 3290 sys_catalog.cc:564] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:51:58.749562 3301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 804004c5f2cf4c10acdee7c4c34d74d5. Latest consensus state: current_term: 1 leader_uuid: "804004c5f2cf4c10acdee7c4c34d74d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804004c5f2cf4c10acdee7c4c34d74d5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45029 } } }
I20260807 22:51:58.749760 3301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:58.749992 3301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "804004c5f2cf4c10acdee7c4c34d74d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804004c5f2cf4c10acdee7c4c34d74d5" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45029 } } }
I20260807 22:51:58.750135 3301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:51:58.750152 3311 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:51:58.753261 3311 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:51:58.758982 3311 catalog_manager.cc:1347] Generated new cluster ID: 2b363a303f8f47908679872b66ecec5e
I20260807 22:51:58.759045 3311 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:51:58.793351 3311 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:51:58.794691 3311 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:51:58.801518 3311 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 804004c5f2cf4c10acdee7c4c34d74d5: Generated new TSK 0
I20260807 22:51:58.802291 3311 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:51:58.818372 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 3219
W20260807 22:51:58.825871 3203 connection.cc:535] client connection to 127.12.112.254:45029 recv error: Network error: failed to read from TLS socket (remote: 127.12.112.254:45029): Connection reset by peer (error 104)
2026-08-07T22:51:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1482 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:51:58 dist-test-slave-tm1g krb5kdc[3327](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:51:58 dist-test-slave-tm1g krb5kdc[3327](info): set up 2 sockets
Aug 07 22:51:58 dist-test-slave-tm1g krb5kdc[3327](info): commencing operation
krb5kdc: starting...
W20260807 22:51:59.874069 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:51:59 dist-test-slave-tm1g krb5kdc[3327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:51:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:51:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:51:59.993829 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:34947
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:36561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:34947
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:52:00.101651 3341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:52:00.101884 3341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:52:00.101924 3341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:52:00.105756 3341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:52:00.105804 3341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:52:00.105823 3341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:52:00.105839 3341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:52:00.105854 3341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:52:00.110760 3341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:36561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:34947
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:34947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:52:00.111634 3341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:52:00.112522 3341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:52:00.120590 3346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:00.120599 3349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:00.120632 3341 server_base.cc:1034] running on GCE node
W20260807 22:52:00.120609 3347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:00.121359 3341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:52:00.122488 3341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:52:00.123698 3341 hybrid_clock.cc:648] HybridClock initialized: now 1786143120123679 us; error 29 us; skew 500 ppm
Aug 07 22:52:00 dist-test-slave-tm1g krb5kdc[3327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:52:00.126587 3341 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:52:00.127437 3341 webserver.cc:460] Webserver started at http://127.12.112.254:41387/ using document root <none> and password file <none>
I20260807 22:52:00.127971 3341 fs_manager.cc:359] Metadata directory not provided
I20260807 22:52:00.128031 3341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:52:00.128264 3341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:52:00.130229 3341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "ed3a980bf8c548aaab1301c83a8d4259"
format_stamp: "Formatted at 2026-08-07 22:52:00 on dist-test-slave-tm1g"
server_key: "d512f12ca89fc05e494352bfa3d6d34a"
server_key_iv: "ad8d14f9450f9f24017a3500e3ce1152"
server_key_version: "encryptionkey@0"
I20260807 22:52:00.130847 3341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "ed3a980bf8c548aaab1301c83a8d4259"
format_stamp: "Formatted at 2026-08-07 22:52:00 on dist-test-slave-tm1g"
server_key: "d512f12ca89fc05e494352bfa3d6d34a"
server_key_iv: "ad8d14f9450f9f24017a3500e3ce1152"
server_key_version: "encryptionkey@0"
I20260807 22:52:00.134435 3341 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:52:00.136654 3356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:52:00.137770 3341 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:52:00.137898 3341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "ed3a980bf8c548aaab1301c83a8d4259"
format_stamp: "Formatted at 2026-08-07 22:52:00 on dist-test-slave-tm1g"
server_key: "d512f12ca89fc05e494352bfa3d6d34a"
server_key_iv: "ad8d14f9450f9f24017a3500e3ce1152"
server_key_version: "encryptionkey@0"
I20260807 22:52:00.138000 3341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:52:00.142658 3341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:52:00.145793 3341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:52:00.145988 3341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:52:00.152946 3341 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:34947
I20260807 22:52:00.152966 3416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:34947 every 8 connection(s)
I20260807 22:52:00.153800 3341 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:52:00.156438 3417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:52:00.159967 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 3341
I20260807 22:52:00.160115 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:52:00.160452 12739 external_mini_cluster.cc:1428] Setting key ff38db0682b5ea746369789589fcf960
I20260807 22:52:00.162189 3417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259: Bootstrap starting.
I20260807 22:52:00.164386 3417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259: Neither blocks nor log segments found. Creating new log.
I20260807 22:52:00.165189 3417 log.cc:824] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259: Log is configured to *not* fsync() on all Append() calls
I20260807 22:52:00.165442 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:00.161799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54319 (local address 127.12.112.254:34947)
0807 22:52:00.162222 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:00.162237 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:00.162270 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:52:00.162949 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:00.162965 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:00.163215 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:00.163537 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:00.164286 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:00.164291 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:00.164301 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:52:00.164311 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:00.164366 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:52:00.164385 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:00.164497 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:00.164596 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 22:52:00.164737 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":119,"threads_started":1}
I20260807 22:52:00.167342 3417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259: No bootstrap required, opened a new log
I20260807 22:52:00.168185 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:52:00.171391 3417 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3a980bf8c548aaab1301c83a8d4259" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34947 } }
I20260807 22:52:00.171661 3417 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:52:00.171684 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:00.170141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43917 (local address 127.12.112.254:34947)
0807 22:52:00.170246 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:00.170250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:00.170453 (+ 203us) server_negotiation.cc:407] Connection header received
0807 22:52:00.170573 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:00.170575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:00.170601 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:00.170658 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:00.171283 (+ 625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:00.171285 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:00.171287 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:52:00.171296 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:00.171318 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:52:00.171328 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:00.171392 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:00.171511 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 22:52:00.171540 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:52:00.171725 3417 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3a980bf8c548aaab1301c83a8d4259, State: Initialized, Role: FOLLOWER
I20260807 22:52:00.172142 3417 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3a980bf8c548aaab1301c83a8d4259" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34947 } }
I20260807 22:52:00.172287 3417 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:52:00.172363 3417 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:52:00.172468 3417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:52:00.173295 3417 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3a980bf8c548aaab1301c83a8d4259" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34947 } }
I20260807 22:52:00.173568 3417 leader_election.cc:302] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed3a980bf8c548aaab1301c83a8d4259; no voters:
I20260807 22:52:00.173789 3417 leader_election.cc:288] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:52:00.173899 3427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:52:00.174171 3427 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [term 1 LEADER]: Becoming Leader. State: Replica: ed3a980bf8c548aaab1301c83a8d4259, State: Running, Role: LEADER
I20260807 22:52:00.174518 3427 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3a980bf8c548aaab1301c83a8d4259" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34947 } }
I20260807 22:52:00.174952 3417 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:52:00.176079 3429 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed3a980bf8c548aaab1301c83a8d4259. Latest consensus state: current_term: 1 leader_uuid: "ed3a980bf8c548aaab1301c83a8d4259" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3a980bf8c548aaab1301c83a8d4259" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34947 } } }
I20260807 22:52:00.176208 3429 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:00.176596 3428 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed3a980bf8c548aaab1301c83a8d4259" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3a980bf8c548aaab1301c83a8d4259" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 34947 } } }
I20260807 22:52:00.176754 3428 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259 [sys.catalog]: This master's current role is: LEADER
W20260807 22:52:00.179515 3443 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:52:00.179603 3443 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:52:00.179682 3436 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:52:00.180387 3436 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:52:00.184849 3436 catalog_manager.cc:1347] Generated new cluster ID: 8b297b1c214642bf8346de8c166b111c
I20260807 22:52:00.184909 3436 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:52:00.199926 3436 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:52:00.200224 3436 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:52:00.206230 3436 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed3a980bf8c548aaab1301c83a8d4259: Generated new TSK 0
I20260807 22:52:00.206936 3436 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:52:00.212390 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 3341
2026-08-07T22:52:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1393 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:52:00 dist-test-slave-tm1g krb5kdc[3449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:52:00 dist-test-slave-tm1g krb5kdc[3449](info): set up 2 sockets
Aug 07 22:52:00 dist-test-slave-tm1g krb5kdc[3449](info): commencing operation
krb5kdc: starting...
W20260807 22:52:01.266275 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:52:01 dist-test-slave-tm1g krb5kdc[3449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:52:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:52:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:52:01.387643 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:38539
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:43987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:38539
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:52:01.498111 3462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:52:01.498428 3462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:52:01.498474 3462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:52:01.502408 3462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:52:01.502457 3462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:52:01.502476 3462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:52:01.502492 3462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:52:01.502543 3462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:52:01.508126 3462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:43987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:38539
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:38539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:52:01.509115 3462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:52:01.510115 3462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:52:01.518514 3462 server_base.cc:1034] running on GCE node
W20260807 22:52:01.518469 3468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:01.518465 3470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:01.518469 3472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:01.519248 3462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:52:01.520291 3462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:52:01.521484 3462 hybrid_clock.cc:648] HybridClock initialized: now 1786143121521458 us; error 38 us; skew 500 ppm
Aug 07 22:52:01 dist-test-slave-tm1g krb5kdc[3449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143121, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:52:01.524276 3462 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:52:01.525146 3462 webserver.cc:460] Webserver started at http://127.12.112.254:40421/ using document root <none> and password file <none>
I20260807 22:52:01.525686 3462 fs_manager.cc:359] Metadata directory not provided
I20260807 22:52:01.525775 3462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:52:01.526012 3462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:52:01.528009 3462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "e281adab627d4e8f806a4e34acb3128f"
format_stamp: "Formatted at 2026-08-07 22:52:01 on dist-test-slave-tm1g"
server_key: "adb42e84423ac8cef725037593624ad6"
server_key_iv: "b209c990a531b26622a26e1ed4a98cd6"
server_key_version: "encryptionkey@0"
I20260807 22:52:01.528566 3462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "e281adab627d4e8f806a4e34acb3128f"
format_stamp: "Formatted at 2026-08-07 22:52:01 on dist-test-slave-tm1g"
server_key: "adb42e84423ac8cef725037593624ad6"
server_key_iv: "b209c990a531b26622a26e1ed4a98cd6"
server_key_version: "encryptionkey@0"
I20260807 22:52:01.532274 3462 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:52:01.534837 3479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:52:01.536028 3462 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:52:01.536168 3462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "e281adab627d4e8f806a4e34acb3128f"
format_stamp: "Formatted at 2026-08-07 22:52:01 on dist-test-slave-tm1g"
server_key: "adb42e84423ac8cef725037593624ad6"
server_key_iv: "b209c990a531b26622a26e1ed4a98cd6"
server_key_version: "encryptionkey@0"
I20260807 22:52:01.536283 3462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:52:01.555699 3462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:52:01.558473 3462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:52:01.558670 3462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:52:01.565714 3462 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:38539
I20260807 22:52:01.565743 3534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:38539 every 8 connection(s)
I20260807 22:52:01.566641 3462 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:52:01.569175 3535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:52:01.574004 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 3462
I20260807 22:52:01.574156 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:52:01.574496 12739 external_mini_cluster.cc:1428] Setting key 879e04ae6810e2e4dd0f295fb94860fc
I20260807 22:52:01.574700 3535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f: Bootstrap starting.
I20260807 22:52:01.577104 3535 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f: Neither blocks nor log segments found. Creating new log.
I20260807 22:52:01.577838 3535 log.cc:824] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:52:01.580003 3535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f: No bootstrap required, opened a new log
Aug 07 22:52:01 dist-test-slave-tm1g krb5kdc[3449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:52:01.584231 3535 raft_consensus.cc:348] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e281adab627d4e8f806a4e34acb3128f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38539 } }
I20260807 22:52:01.584504 3535 raft_consensus.cc:374] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:52:01.584579 3535 raft_consensus.cc:729] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e281adab627d4e8f806a4e34acb3128f, State: Initialized, Role: FOLLOWER
I20260807 22:52:01.585078 3535 consensus_queue.cc:260] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e281adab627d4e8f806a4e34acb3128f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38539 } }
I20260807 22:52:01.585248 3535 raft_consensus.cc:388] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:52:01.585340 3535 raft_consensus.cc:482] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:52:01.585441 3535 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:52:01.586599 3535 raft_consensus.cc:504] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e281adab627d4e8f806a4e34acb3128f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38539 } }
I20260807 22:52:01.586984 3535 leader_election.cc:302] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e281adab627d4e8f806a4e34acb3128f; no voters:
I20260807 22:52:01.587321 3535 leader_election.cc:288] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:52:01.587432 3540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:52:01.587723 3540 raft_consensus.cc:686] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [term 1 LEADER]: Becoming Leader. State: Replica: e281adab627d4e8f806a4e34acb3128f, State: Running, Role: LEADER
I20260807 22:52:01.588032 3540 consensus_queue.cc:237] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e281adab627d4e8f806a4e34acb3128f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38539 } }
I20260807 22:52:01.588598 3535 sys_catalog.cc:564] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:52:01.589831 3538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:01.575773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45815 (local address 127.12.112.254:38539)
0807 22:52:01.576214 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:01.576229 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:01.576264 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:52:01.576845 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:01.576861 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:01.577172 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:01.577531 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:01.578414 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:01.579813 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:01.580704 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:01.581408 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:01.581558 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:01.584212 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:01.584219 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:01.584233 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:01.584276 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:01.586528 (+ 2252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:01.586983 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:01.587000 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:01.587008 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:01.587172 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:01.587552 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:01.587559 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:01.587564 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:01.588062 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:01.588318 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:01.588546 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 22:52:01.588841 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":137,"threads_started":1}
I20260807 22:52:01.589947 3542 sys_catalog.cc:455] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e281adab627d4e8f806a4e34acb3128f. Latest consensus state: current_term: 1 leader_uuid: "e281adab627d4e8f806a4e34acb3128f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e281adab627d4e8f806a4e34acb3128f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38539 } } }
I20260807 22:52:01.590188 3542 sys_catalog.cc:458] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:01.589958 3541 sys_catalog.cc:455] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e281adab627d4e8f806a4e34acb3128f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e281adab627d4e8f806a4e34acb3128f" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38539 } } }
I20260807 22:52:01.590529 3541 sys_catalog.cc:458] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:01.593245 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 22:52:01.593387 3555 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:52:01.593443 3555 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:52:01.593526 3551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:52:01.594424 3551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:52:01.600147 3551 catalog_manager.cc:1347] Generated new cluster ID: 8edd3d932dda41898ad4175dc2f2c5e2
I20260807 22:52:01.600205 3551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:52:01.603652 3538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:01.595557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54807 (local address 127.12.112.254:38539)
0807 22:52:01.595675 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:01.595681 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:01.595694 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:52:01.595724 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:01.595727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:01.595769 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:01.595853 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:01.596568 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:01.597309 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:01.598383 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:01.598764 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:01.598889 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:01.600400 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:01.600404 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:01.600407 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:01.600430 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:01.602049 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:01.602512 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:01.602515 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:01.602517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:01.602590 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:01.602856 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:01.602860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:01.602861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:01.603034 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:01.603115 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:01.603416 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 22:52:01.603513 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:52:01.623147 3551 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:52:01.624009 3551 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:52:01.630251 3551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e281adab627d4e8f806a4e34acb3128f: Generated new TSK 0
I20260807 22:52:01.631031 3551 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:52:01.639083 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 3462
2026-08-07T22:52:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1427 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:52:01 dist-test-slave-tm1g krb5kdc[3566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:52:01 dist-test-slave-tm1g krb5kdc[3566](info): set up 2 sockets
Aug 07 22:52:01 dist-test-slave-tm1g krb5kdc[3566](info): commencing operation
krb5kdc: starting...
W20260807 22:52:02.717868 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:52:02 dist-test-slave-tm1g krb5kdc[3566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:52:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:52:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:52:02.840855 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:45977
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:39955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:45977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:52:02.951373 3579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:52:02.951664 3579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:52:02.951747 3579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:52:02.955695 3579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:52:02.955787 3579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:52:02.955827 3579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:52:02.955895 3579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:52:02.955941 3579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:52:02.961527 3579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:39955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:45977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:45977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:52:02.962608 3579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:52:02.963651 3579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:52:02.972097 3588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:02.972158 3579 server_base.cc:1034] running on GCE node
W20260807 22:52:02.972064 3584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:02.972080 3585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:02.973052 3579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:52:02.974115 3579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:52:02.975281 3579 hybrid_clock.cc:648] HybridClock initialized: now 1786143122975280 us; error 54 us; skew 500 ppm
Aug 07 22:52:02 dist-test-slave-tm1g krb5kdc[3566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143122, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:52:02.981753 3579 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:52:02.982702 3579 webserver.cc:460] Webserver started at http://127.12.112.254:37813/ using document root <none> and password file <none>
I20260807 22:52:02.983247 3579 fs_manager.cc:359] Metadata directory not provided
I20260807 22:52:02.983340 3579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:52:02.983572 3579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:52:02.985576 3579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "194c526f52b941c4acea79ca9b037e03"
format_stamp: "Formatted at 2026-08-07 22:52:02 on dist-test-slave-tm1g"
server_key: "2bf02992e953b45fcb9565df4ed58f50"
server_key_iv: "01fffa177ac44f26e85a14fd2ed0bb70"
server_key_version: "encryptionkey@0"
I20260807 22:52:02.986147 3579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "194c526f52b941c4acea79ca9b037e03"
format_stamp: "Formatted at 2026-08-07 22:52:02 on dist-test-slave-tm1g"
server_key: "2bf02992e953b45fcb9565df4ed58f50"
server_key_iv: "01fffa177ac44f26e85a14fd2ed0bb70"
server_key_version: "encryptionkey@0"
I20260807 22:52:02.989835 3579 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:52:02.992240 3596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:52:02.993389 3579 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:52:02.993526 3579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "194c526f52b941c4acea79ca9b037e03"
format_stamp: "Formatted at 2026-08-07 22:52:02 on dist-test-slave-tm1g"
server_key: "2bf02992e953b45fcb9565df4ed58f50"
server_key_iv: "01fffa177ac44f26e85a14fd2ed0bb70"
server_key_version: "encryptionkey@0"
I20260807 22:52:02.993631 3579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:52:03.006973 3579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:52:03.010027 3579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:52:03.010224 3579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:52:03.017072 3579 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:45977
I20260807 22:52:03.017092 3653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:45977 every 8 connection(s)
I20260807 22:52:03.017961 3579 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:52:03.020612 3654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:52:03.025856 3654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03: Bootstrap starting.
I20260807 22:52:03.027112 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 3579
I20260807 22:52:03.027293 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:52:03.027558 12739 external_mini_cluster.cc:1428] Setting key 01da03b8c3799e75e1bf4ff564ffa57a
I20260807 22:52:03.028484 3654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03: Neither blocks nor log segments found. Creating new log.
I20260807 22:52:03.029289 3654 log.cc:824] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03: Log is configured to *not* fsync() on all Append() calls
I20260807 22:52:03.031363 3654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03: No bootstrap required, opened a new log
I20260807 22:52:03.035578 3654 raft_consensus.cc:348] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194c526f52b941c4acea79ca9b037e03" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45977 } }
I20260807 22:52:03.035821 3654 raft_consensus.cc:374] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:52:03.035908 3654 raft_consensus.cc:729] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 194c526f52b941c4acea79ca9b037e03, State: Initialized, Role: FOLLOWER
I20260807 22:52:03.036329 3654 consensus_queue.cc:260] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194c526f52b941c4acea79ca9b037e03" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45977 } }
I20260807 22:52:03.036473 3654 raft_consensus.cc:388] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:52:03.036561 3654 raft_consensus.cc:482] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:52:03.036583 3657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:03.028682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47335 (local address 127.12.112.254:45977)
0807 22:52:03.029085 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:03.029101 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:03.029134 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:52:03.029878 (+ 744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:03.029903 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:03.030276 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:03.030611 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:03.030979 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:03.032010 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:03.033247 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:03.033702 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:03.033826 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:03.034748 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:03.034752 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:03.034763 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:52:03.035118 (+ 355us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:03.035169 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:52:03.035189 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:03.035263 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:03.035435 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 22:52:03.035652 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":132,"threads_started":1}
I20260807 22:52:03.036688 3654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:52:03.037566 3654 raft_consensus.cc:504] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194c526f52b941c4acea79ca9b037e03" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45977 } }
I20260807 22:52:03.037897 3654 leader_election.cc:302] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 194c526f52b941c4acea79ca9b037e03; no voters:
I20260807 22:52:03.038219 3654 leader_election.cc:288] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:52:03.038357 3659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:52:03.038583 3659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [term 1 LEADER]: Becoming Leader. State: Replica: 194c526f52b941c4acea79ca9b037e03, State: Running, Role: LEADER
I20260807 22:52:03.038877 3659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194c526f52b941c4acea79ca9b037e03" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45977 } }
I20260807 22:52:03.039393 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:52:03.039557 3654 sys_catalog.cc:564] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:52:03.040032 3659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "194c526f52b941c4acea79ca9b037e03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194c526f52b941c4acea79ca9b037e03" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45977 } } }
I20260807 22:52:03.040141 3659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:03.040365 3659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 194c526f52b941c4acea79ca9b037e03. Latest consensus state: current_term: 1 leader_uuid: "194c526f52b941c4acea79ca9b037e03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194c526f52b941c4acea79ca9b037e03" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 45977 } } }
I20260807 22:52:03.040455 3659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03 [sys.catalog]: This master's current role is: LEADER
W20260807 22:52:03.044859 3680 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:52:03.044973 3680 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:52:03.045089 3663 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:52:03.046020 3663 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:52:03.046648 3657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:03.041881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45169 (local address 127.12.112.254:45977)
0807 22:52:03.041993 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:03.041997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:03.042324 (+ 327us) server_negotiation.cc:407] Connection header received
0807 22:52:03.042739 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:03.042742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:03.042809 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:03.042893 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:03.043150 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:03.043808 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:03.044879 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:03.045199 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:03.045328 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:03.046167 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:03.046171 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:03.046173 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:52:03.046185 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:03.046213 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:52:03.046226 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:03.046318 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:03.046469 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 22:52:03.046532 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:52:03.051743 3663 catalog_manager.cc:1347] Generated new cluster ID: bf7031627dd3440e9ad0b671a48b9d37
I20260807 22:52:03.051815 3663 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:52:03.076612 3663 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:52:03.077550 3663 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:52:03.085410 3663 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 194c526f52b941c4acea79ca9b037e03: Generated new TSK 0
I20260807 22:52:03.086071 3663 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:52:03.090487 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 3579
2026-08-07T22:52:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:52:03 dist-test-slave-tm1g krb5kdc[3685](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:52:03 dist-test-slave-tm1g krb5kdc[3685](info): set up 2 sockets
Aug 07 22:52:03 dist-test-slave-tm1g krb5kdc[3685](info): commencing operation
krb5kdc: starting...
W20260807 22:52:04.152901 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:52:04 dist-test-slave-tm1g krb5kdc[3685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:52:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:52:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:52:04.271417 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33809
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:33809
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:52:04.379015 3699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:52:04.379251 3699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:52:04.379289 3699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:52:04.383210 3699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:52:04.383260 3699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:52:04.383278 3699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:52:04.383294 3699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:52:04.383356 3699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:52:04.388449 3699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:33809
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:33809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:52:04.389402 3699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:52:04.390573 3699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:52:04.399509 3707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:04.399518 3706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:04.399528 3709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:04.399789 3699 server_base.cc:1034] running on GCE node
I20260807 22:52:04.400353 3699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:52:04.401366 3699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:52:04.402551 3699 hybrid_clock.cc:648] HybridClock initialized: now 1786143124402533 us; error 29 us; skew 500 ppm
Aug 07 22:52:04 dist-test-slave-tm1g krb5kdc[3685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143124, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:52:04.405162 3699 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:52:04.406035 3699 webserver.cc:460] Webserver started at http://127.12.112.254:40457/ using document root <none> and password file <none>
I20260807 22:52:04.406634 3699 fs_manager.cc:359] Metadata directory not provided
I20260807 22:52:04.406725 3699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:52:04.406955 3699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:52:04.408877 3699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "b79025c8388f4b03ba453276ce1ead4a"
format_stamp: "Formatted at 2026-08-07 22:52:04 on dist-test-slave-tm1g"
server_key: "d0f7f6b4b030485a4c8a541fbad5d9d6"
server_key_iv: "e0b42fc62b473da573f6cff55c25d593"
server_key_version: "encryptionkey@0"
I20260807 22:52:04.409437 3699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "b79025c8388f4b03ba453276ce1ead4a"
format_stamp: "Formatted at 2026-08-07 22:52:04 on dist-test-slave-tm1g"
server_key: "d0f7f6b4b030485a4c8a541fbad5d9d6"
server_key_iv: "e0b42fc62b473da573f6cff55c25d593"
server_key_version: "encryptionkey@0"
I20260807 22:52:04.412933 3699 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:52:04.415199 3716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:52:04.416374 3699 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:52:04.416517 3699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "b79025c8388f4b03ba453276ce1ead4a"
format_stamp: "Formatted at 2026-08-07 22:52:04 on dist-test-slave-tm1g"
server_key: "d0f7f6b4b030485a4c8a541fbad5d9d6"
server_key_iv: "e0b42fc62b473da573f6cff55c25d593"
server_key_version: "encryptionkey@0"
I20260807 22:52:04.416607 3699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:52:04.421000 3699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:52:04.423992 3699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:52:04.424193 3699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:52:04.431185 3699 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:33809
I20260807 22:52:04.431198 3771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:33809 every 8 connection(s)
I20260807 22:52:04.432089 3699 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:52:04.434805 3772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:52:04.436879 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 3699
I20260807 22:52:04.437041 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:52:04.437326 12739 external_mini_cluster.cc:1428] Setting key fadddc9e9a1a627066a07e3590fff3fc
I20260807 22:52:04.440601 3772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a: Bootstrap starting.
I20260807 22:52:04.442260 3776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:04.438635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52925 (local address 127.12.112.254:33809)
0807 22:52:04.439052 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:04.439066 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:04.439101 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:52:04.439709 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:04.439724 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:04.439993 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:04.440255 (+ 262us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:04.441082 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:04.441086 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:04.441097 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:52:04.441108 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:04.441160 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:52:04.441178 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:04.441285 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:04.441409 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 22:52:04.441579 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":134,"threads_started":1}
I20260807 22:52:04.443045 3772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a: Neither blocks nor log segments found. Creating new log.
I20260807 22:52:04.443951 3772 log.cc:824] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:52:04.445211 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:52:04.446031 3772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a: No bootstrap required, opened a new log
I20260807 22:52:04.448843 3776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:04.447334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38087 (local address 127.12.112.254:33809)
0807 22:52:04.447448 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:04.447452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:04.447599 (+ 147us) server_negotiation.cc:407] Connection header received
0807 22:52:04.447708 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:04.447710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:04.447738 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:04.447801 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:04.448436 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:04.448438 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:04.448440 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:52:04.448450 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:04.448474 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:52:04.448483 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:04.448549 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:04.448658 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 22:52:04.448689 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:52:04.450737 3772 raft_consensus.cc:348] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79025c8388f4b03ba453276ce1ead4a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33809 } }
I20260807 22:52:04.450973 3772 raft_consensus.cc:374] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:52:04.451041 3772 raft_consensus.cc:729] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b79025c8388f4b03ba453276ce1ead4a, State: Initialized, Role: FOLLOWER
I20260807 22:52:04.451521 3772 consensus_queue.cc:260] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79025c8388f4b03ba453276ce1ead4a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33809 } }
I20260807 22:52:04.451718 3772 raft_consensus.cc:388] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:52:04.451790 3772 raft_consensus.cc:482] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:52:04.451890 3772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:52:04.452742 3772 raft_consensus.cc:504] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79025c8388f4b03ba453276ce1ead4a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33809 } }
I20260807 22:52:04.453088 3772 leader_election.cc:302] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b79025c8388f4b03ba453276ce1ead4a; no voters:
I20260807 22:52:04.453382 3772 leader_election.cc:288] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:52:04.453508 3784 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:52:04.453732 3784 raft_consensus.cc:686] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [term 1 LEADER]: Becoming Leader. State: Replica: b79025c8388f4b03ba453276ce1ead4a, State: Running, Role: LEADER
I20260807 22:52:04.454088 3784 consensus_queue.cc:237] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79025c8388f4b03ba453276ce1ead4a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33809 } }
I20260807 22:52:04.454613 3772 sys_catalog.cc:564] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:52:04.455731 3785 sys_catalog.cc:455] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b79025c8388f4b03ba453276ce1ead4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79025c8388f4b03ba453276ce1ead4a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33809 } } }
I20260807 22:52:04.455863 3785 sys_catalog.cc:458] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:04.456224 3786 sys_catalog.cc:455] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b79025c8388f4b03ba453276ce1ead4a. Latest consensus state: current_term: 1 leader_uuid: "b79025c8388f4b03ba453276ce1ead4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79025c8388f4b03ba453276ce1ead4a" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 33809 } } }
I20260807 22:52:04.456373 3786 sys_catalog.cc:458] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:04.457053 3793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:52:04.459535 3793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:52:04.464874 3793 catalog_manager.cc:1347] Generated new cluster ID: b8dd50b0449f4bf0a6343972c135177d
I20260807 22:52:04.464948 3793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:52:04.476331 3793 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:52:04.476619 3793 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:52:04.481055 3793 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b79025c8388f4b03ba453276ce1ead4a: Generated new TSK 0
I20260807 22:52:04.481748 3793 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:52:04.486819 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 3699
2026-08-07T22:52:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1397 ms)
[----------] 18 tests from AuthTokenIssuingTest (26353 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:52:04 dist-test-slave-tm1g krb5kdc[3806](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:52:04 dist-test-slave-tm1g krb5kdc[3806](info): set up 2 sockets
Aug 07 22:52:04 dist-test-slave-tm1g krb5kdc[3806](info): commencing operation
krb5kdc: starting...
W20260807 22:52:05.558537 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:52:05 dist-test-slave-tm1g krb5kdc[3806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:52:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:52:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:52:05.674999 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:39667
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:32995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:39667,127.12.112.253:34025,127.12.112.252:41405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:52:05.786128 3819 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:52:05.786471 3819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:52:05.786521 3819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:52:05.786588 3819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:52:05.790608 3819 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:52:05.790657 3819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:52:05.790676 3819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:52:05.790693 3819 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:52:05.790709 3819 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:52:05.795830 3819 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:32995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:39667,127.12.112.253:34025,127.12.112.252:41405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:39667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:52:05.796844 3819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:52:05.797850 3819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:52:05.806654 3828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:05.806644 3826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:05.806640 3825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:05.806891 3819 server_base.cc:1034] running on GCE node
I20260807 22:52:05.807463 3819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:52:05.808562 3819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:52:05.809759 3819 hybrid_clock.cc:648] HybridClock initialized: now 1786143125809744 us; error 32 us; skew 500 ppm
Aug 07 22:52:05 dist-test-slave-tm1g krb5kdc[3806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143125, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:52:05.812397 3819 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:52:05.813271 3819 webserver.cc:460] Webserver started at http://127.12.112.254:34969/ using document root <none> and password file <none>
I20260807 22:52:05.813824 3819 fs_manager.cc:359] Metadata directory not provided
I20260807 22:52:05.813920 3819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:52:05.814162 3819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:52:05.816200 3819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "be4463b6f73642c0b867a0c2211c9fcf"
format_stamp: "Formatted at 2026-08-07 22:52:05 on dist-test-slave-tm1g"
server_key: "cc818cbd22e5b193409e681c3ffe5324"
server_key_iv: "dcf0c144397e3e1696e8a9fbe886edec"
server_key_version: "encryptionkey@0"
I20260807 22:52:05.816782 3819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "be4463b6f73642c0b867a0c2211c9fcf"
format_stamp: "Formatted at 2026-08-07 22:52:05 on dist-test-slave-tm1g"
server_key: "cc818cbd22e5b193409e681c3ffe5324"
server_key_iv: "dcf0c144397e3e1696e8a9fbe886edec"
server_key_version: "encryptionkey@0"
I20260807 22:52:05.820511 3819 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:52:05.822793 3835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:52:05.823966 3819 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:52:05.824105 3819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "be4463b6f73642c0b867a0c2211c9fcf"
format_stamp: "Formatted at 2026-08-07 22:52:05 on dist-test-slave-tm1g"
server_key: "cc818cbd22e5b193409e681c3ffe5324"
server_key_iv: "dcf0c144397e3e1696e8a9fbe886edec"
server_key_version: "encryptionkey@0"
I20260807 22:52:05.824211 3819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:52:05.841208 3819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:52:05.843895 3819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:52:05.844115 3819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:52:05.850721 3819 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:39667
I20260807 22:52:05.851012 3888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:39667 every 8 connection(s)
I20260807 22:52:05.851666 3819 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:52:05.854476 3889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:52:05.858016 3889 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:05.860834 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 3819
I20260807 22:52:05.860978 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:52:05.861296 12739 external_mini_cluster.cc:1428] Setting key e6aba69708cf9bb96ab4423615d4790e
Aug 07 22:52:05 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143125, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.253@KRBTEST.COM" created.
I20260807 22:52:05.873564 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:05.860188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54918 (local address 127.12.112.254:39667)
0807 22:52:05.861325 (+ 1137us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:05.861345 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:05.861481 (+ 136us) server_negotiation.cc:407] Connection header received
0807 22:52:05.862590 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:05.862595 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:05.862757 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:05.862945 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:05.863770 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:05.864619 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:05.865634 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:05.866327 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:05.866519 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:05.868780 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:05.868789 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:05.868805 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:05.868832 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:05.870656 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:05.871118 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:05.871123 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:05.871124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:05.871225 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:05.871593 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:05.871596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:05.871598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:05.872028 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:05.872134 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:05.872580 (+ 446us) server_negotiation.cc:299] Negotiation successful
0807 22:52:05.872852 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":116,"server-negotiator.queue_time_us":999,"spinlock_wait_cycles":46080,"thread_start_us":174,"threads_started":1}
I20260807 22:52:05.873571 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:05.860188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39667 (local address 127.0.0.1:54918)
0807 22:52:05.861288 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:05.861363 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:05.862198 (+ 835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:05.862943 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:05.862948 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:05.863387 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:05.863615 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:05.863628 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:05.864743 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:05.864746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:05.865474 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:05.865483 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:05.866491 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:05.866494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:05.866576 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:05.867197 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:05.867212 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:05.868618 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:05.870753 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:05.870761 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:05.870768 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:05.870999 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:05.871369 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:05.871371 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:05.871373 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:05.871487 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:05.872142 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:05.872147 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:05.872262 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 22:52:05.872470 (+ 208us) client_negotiation.cc:240] Negotiation successful
0807 22:52:05.872756 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":917,"mutex_wait_us":23,"thread_start_us":137,"threads_started":1}
I20260807 22:52:05.875804 3889 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:05.876523 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:05.876288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:34025 (local address 127.0.0.1:58240)
0807 22:52:05.876399 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:05.876472 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 22:52:05.876794 3838 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.112.253:34025: connect: Connection refused (error 111)
I20260807 22:52:05.877714 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:05.877424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:34025 (local address 127.0.0.1:58242)
0807 22:52:05.877619 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:05.877666 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
W20260807 22:52:05.877979 3889 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.253:34025: Network error: Client connection negotiation failed: client connection to 127.12.112.253:34025: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab.
Entry for principal kudu/127.12.112.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab.
I20260807 22:52:05.887511 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.253:34025
--webserver_interface=127.12.112.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab
--principal=kudu/127.12.112.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:32995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:39667,127.12.112.253:34025,127.12.112.252:41405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:52:05.927243 3889 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } attempt: 1
I20260807 22:52:05.928207 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:05.927888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:34025 (local address 127.0.0.1:58254)
0807 22:52:05.928053 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:05.928118 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 22:52:05.929037 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:05.928764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:34025 (local address 127.0.0.1:58258)
0807 22:52:05.928875 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:05.928921 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 22:52:05.929208 3889 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.253:34025: Network error: Client connection negotiation failed: client connection to 127.12.112.253:34025: connect: Connection refused (error 111)
W20260807 22:52:05.994791 3896 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:52:05.995090 3896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:52:05.995165 3896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:52:05.995246 3896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 22:52:05.997380 3889 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } attempt: 2
I20260807 22:52:05.998253 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:05.997935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:34025 (local address 127.0.0.1:58262)
0807 22:52:05.998117 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:05.998179 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 22:52:05.999007 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:05.998807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:34025 (local address 127.0.0.1:58268)
0807 22:52:05.998908 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:05.998952 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 22:52:05.999151 3889 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.253:34025: Network error: Client connection negotiation failed: client connection to 127.12.112.253:34025: connect: Connection refused (error 111)
W20260807 22:52:05.999805 3896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:52:05.999881 3896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:52:05.999922 3896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:52:05.999956 3896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:52:05.999987 3896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:52:06.005347 3896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:32995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:39667,127.12.112.253:34025,127.12.112.252:41405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab
--principal=kudu/127.12.112.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.253:34025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.112.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:52:06.006421 3896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:52:06.007392 3896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:52:06.015857 3904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:06.015895 3902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:06.015903 3901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:06.016049 3896 server_base.cc:1034] running on GCE node
I20260807 22:52:06.016683 3896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:52:06.017725 3896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:52:06.018894 3896 hybrid_clock.cc:648] HybridClock initialized: now 1786143126018876 us; error 30 us; skew 500 ppm
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143126, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:52:06.021554 3896 init.cc:377] Logged in from keytab as kudu/127.12.112.253@KRBTEST.COM (short username kudu)
I20260807 22:52:06.022433 3896 webserver.cc:460] Webserver started at http://127.12.112.253:45037/ using document root <none> and password file <none>
I20260807 22:52:06.023008 3896 fs_manager.cc:359] Metadata directory not provided
I20260807 22:52:06.023098 3896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:52:06.023319 3896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:52:06.025287 3896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/data/instance:
uuid: "fc5c46417a8a4e32bba198d1d7028013"
format_stamp: "Formatted at 2026-08-07 22:52:06 on dist-test-slave-tm1g"
server_key: "63150141e66e68c1c503fab47d41a3f3"
server_key_iv: "a6bda5075f415d9faa9feddc59a78b56"
server_key_version: "encryptionkey@0"
I20260807 22:52:06.025852 3896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/wal/instance:
uuid: "fc5c46417a8a4e32bba198d1d7028013"
format_stamp: "Formatted at 2026-08-07 22:52:06 on dist-test-slave-tm1g"
server_key: "63150141e66e68c1c503fab47d41a3f3"
server_key_iv: "a6bda5075f415d9faa9feddc59a78b56"
server_key_version: "encryptionkey@0"
I20260807 22:52:06.029528 3896 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260807 22:52:06.031816 3912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:52:06.032902 3896 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:52:06.033064 3896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/wal
uuid: "fc5c46417a8a4e32bba198d1d7028013"
format_stamp: "Formatted at 2026-08-07 22:52:06 on dist-test-slave-tm1g"
server_key: "63150141e66e68c1c503fab47d41a3f3"
server_key_iv: "a6bda5075f415d9faa9feddc59a78b56"
server_key_version: "encryptionkey@0"
I20260807 22:52:06.033174 3896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:52:06.055169 3896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:52:06.057822 3896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:52:06.058022 3896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:52:06.064845 3896 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.253:34025
I20260807 22:52:06.065150 3967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.253:34025 every 8 connection(s)
I20260807 22:52:06.065779 3896 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
I20260807 22:52:06.068691 3968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:52:06.072413 3968 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:06.073393 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 3896
I20260807 22:52:06.073554 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-1/wal/instance
I20260807 22:52:06.073899 12739 external_mini_cluster.cc:1428] Setting key 493f2b6bcc4442ebef29d09e576b89d9
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143126, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.112.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.252@KRBTEST.COM" created.
I20260807 22:52:06.087914 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.074371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54924 (local address 127.12.112.254:39667)
0807 22:52:06.074511 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.074515 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.075441 (+ 926us) server_negotiation.cc:407] Connection header received
0807 22:52:06.076648 (+ 1207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.076652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.076700 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.076789 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.078108 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.079057 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.080165 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.080613 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.080750 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.083457 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.083460 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.083463 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.083487 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.085484 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.086088 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.086095 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.086098 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.086188 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.086607 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.086609 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.086611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.086789 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.086871 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.087539 (+ 668us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.087691 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:52:06.088601 3971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.074815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39667 (local address 127.0.0.1:54924)
0807 22:52:06.075295 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.075337 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:06.076395 (+ 1058us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:06.076980 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:06.076990 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:06.077491 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:06.077941 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.077954 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.079188 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.079191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.080037 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.080045 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.080761 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.080764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.080897 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.081491 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:06.081509 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:06.083269 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:06.085654 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.085666 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.085676 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.085985 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.086286 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.086292 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.086296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.086505 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.086897 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:06.086906 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:06.087222 (+ 316us) client_negotiation.cc:769] Sending connection context
0807 22:52:06.087430 (+ 208us) client_negotiation.cc:240] Negotiation successful
0807 22:52:06.087741 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":143,"threads_started":1}
I20260807 22:52:06.090027 3968 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:06.090356 3889 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } attempt: 3
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143126, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143125, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
I20260807 22:52:06.102469 3971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.090618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:34025 (local address 127.0.0.1:58272)
0807 22:52:06.091293 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.091306 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:06.091376 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:06.091738 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:06.091741 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:06.091912 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:06.092005 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.092010 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.092948 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.092954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.093590 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.093600 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.094527 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.094533 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.094665 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.095095 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:06.095105 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:06.097400 (+ 2295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:06.100551 (+ 3151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.100554 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.100556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.100839 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.101228 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.101230 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.101238 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.101323 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.101941 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:06.101944 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:06.102037 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 22:52:06.102150 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:52:06.102276 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"mutex_wait_us":22}
I20260807 22:52:06.102469 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.090867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:34025 (local address 127.0.0.1:58274)
0807 22:52:06.091011 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.091026 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:06.091106 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:06.091811 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:06.091816 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:06.092010 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:06.092133 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.092142 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.093355 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.093358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.094007 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.094016 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.094620 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.094624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.094730 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.095216 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:06.095229 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:06.097987 (+ 2758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:06.100551 (+ 2564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.100554 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.100557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.100839 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.101223 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.101226 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.101228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.101330 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.101941 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:06.101944 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:06.102037 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 22:52:06.102150 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:52:06.102276 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 22:52:06.102706 3975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.091087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58274 (local address 127.12.112.253:34025)
0807 22:52:06.091416 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.091427 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.091444 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:52:06.091488 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.091505 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.091643 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.092258 (+ 615us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.092362 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.093231 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.094132 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.094487 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.094901 (+ 414us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.098148 (+ 3247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.098151 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.098153 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.098174 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.100415 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.100958 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.100964 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.100966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.101116 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.101421 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.101425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.101427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.101827 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.101969 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.102267 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.102470 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":239,"spinlock_wait_cycles":28800,"thread_start_us":97,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab.
Entry for principal kudu/127.12.112.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab.
I20260807 22:52:06.103719 3974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.090753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58272 (local address 127.12.112.253:34025)
0807 22:52:06.091319 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.091333 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.091355 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:52:06.091454 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.091459 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.091625 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.091760 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.092114 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.092833 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.093723 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.094404 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.094517 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.097558 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.097570 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.097585 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.097618 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.100415 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.100958 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.100964 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.100966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.101122 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.101421 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.101425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.101427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.101827 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.101969 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.102267 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.103558 (+ 1291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1166,"server-negotiator.queue_time_us":485,"spinlock_wait_cycles":17664,"thread_start_us":156,"threads_started":1}
I20260807 22:52:06.103977 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.252:41405
--webserver_interface=127.12.112.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab
--principal=kudu/127.12.112.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:32995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:39667,127.12.112.253:34025,127.12.112.252:41405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:52:06.104707 3968 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:06.105074 3889 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:06.105517 3971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.105180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:57934)
0807 22:52:06.105365 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.105454 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
W20260807 22:52:06.105736 3913 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
I20260807 22:52:06.105870 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.105532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:57940)
0807 22:52:06.105743 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.105798 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260807 22:52:06.106674 3971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.106461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:57958)
0807 22:52:06.106580 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.106629 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 22:52:06.106727 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.106407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:57954)
0807 22:52:06.106592 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.106648 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260807 22:52:06.106844 3968 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:41405: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
W20260807 22:52:06.106887 3889 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:41405: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
I20260807 22:52:06.138065 3889 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } attempt: 1
I20260807 22:52:06.138840 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.138564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:57970)
0807 22:52:06.138710 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.138771 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 22:52:06.139544 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.139320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:57980)
0807 22:52:06.139437 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.139488 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 22:52:06.139703 3889 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:41405: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
I20260807 22:52:06.156091 3968 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } attempt: 1
I20260807 22:52:06.156873 3971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.156564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:57984)
0807 22:52:06.156710 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.156780 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 22:52:06.157590 3971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.157366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:57998)
0807 22:52:06.157478 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.157530 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 22:52:06.157727 3968 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:41405: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
I20260807 22:52:06.214850 3889 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } attempt: 2
I20260807 22:52:06.215807 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.215397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:58002)
0807 22:52:06.215640 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.215715 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
I20260807 22:52:06.216588 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.216350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:58006)
0807 22:52:06.216464 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.216529 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 22:52:06.216718 3889 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:41405: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
W20260807 22:52:06.220342 3976 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:52:06.220629 3976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:52:06.220688 3976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:52:06.220768 3976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:52:06.224754 3976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:52:06.224833 3976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:52:06.224877 3976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:52:06.224934 3976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:52:06.224970 3976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:52:06.225915 3968 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } attempt: 2
I20260807 22:52:06.226684 3971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.226394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:58014)
0807 22:52:06.226542 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.226605 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 22:52:06.227386 3971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.227165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:58026)
0807 22:52:06.227273 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.227324 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 22:52:06.227542 3968 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:41405: Network error: Client connection negotiation failed: client connection to 127.12.112.252:41405: connect: Connection refused (error 111)
I20260807 22:52:06.230679 3976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:32995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:39667,127.12.112.253:34025,127.12.112.252:41405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab
--principal=kudu/127.12.112.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.252:41405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.112.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:52:06.231645 3976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:52:06.232609 3976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:52:06.240933 3985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:06.240919 3982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:06.240916 3983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:06.241189 3976 server_base.cc:1034] running on GCE node
I20260807 22:52:06.241856 3976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:52:06.242962 3976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:52:06.244158 3976 hybrid_clock.cc:648] HybridClock initialized: now 1786143126244144 us; error 30 us; skew 500 ppm
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143126, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:52:06.246829 3976 init.cc:377] Logged in from keytab as kudu/127.12.112.252@KRBTEST.COM (short username kudu)
I20260807 22:52:06.247658 3976 webserver.cc:460] Webserver started at http://127.12.112.252:33511/ using document root <none> and password file <none>
I20260807 22:52:06.248205 3976 fs_manager.cc:359] Metadata directory not provided
I20260807 22:52:06.248298 3976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:52:06.248529 3976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:52:06.250584 3976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/data/instance:
uuid: "3fbad228954f4d5c90de84529b1d98d1"
format_stamp: "Formatted at 2026-08-07 22:52:06 on dist-test-slave-tm1g"
server_key: "c271e4c6aada7f708e0b76f4265521ff"
server_key_iv: "3c39200ad1bb288fbac6f6fd1d856f1a"
server_key_version: "encryptionkey@0"
I20260807 22:52:06.251148 3976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/wal/instance:
uuid: "3fbad228954f4d5c90de84529b1d98d1"
format_stamp: "Formatted at 2026-08-07 22:52:06 on dist-test-slave-tm1g"
server_key: "c271e4c6aada7f708e0b76f4265521ff"
server_key_iv: "3c39200ad1bb288fbac6f6fd1d856f1a"
server_key_version: "encryptionkey@0"
I20260807 22:52:06.254812 3976 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:52:06.257144 3992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:52:06.258419 3976 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:52:06.258548 3976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/wal
uuid: "3fbad228954f4d5c90de84529b1d98d1"
format_stamp: "Formatted at 2026-08-07 22:52:06 on dist-test-slave-tm1g"
server_key: "c271e4c6aada7f708e0b76f4265521ff"
server_key_iv: "3c39200ad1bb288fbac6f6fd1d856f1a"
server_key_version: "encryptionkey@0"
I20260807 22:52:06.258664 3976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:52:06.272881 3976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:52:06.275818 3976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:52:06.276022 3976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:52:06.282912 3976 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.252:41405
I20260807 22:52:06.283200 4045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.252:41405 every 8 connection(s)
I20260807 22:52:06.283874 3976 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
I20260807 22:52:06.286636 4046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:52:06.290187 4046 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:06.290992 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 3976
I20260807 22:52:06.291141 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142843719124-12739-0/minicluster-data/master-2/wal/instance
I20260807 22:52:06.291414 12739 external_mini_cluster.cc:1428] Setting key e85bceec80f0555aa4215cde0c7f0bd5
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143126, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
I20260807 22:52:06.303885 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.292172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54936 (local address 127.12.112.254:39667)
0807 22:52:06.292334 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.292339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.293324 (+ 985us) server_negotiation.cc:407] Connection header received
0807 22:52:06.294136 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.294139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.294187 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.294261 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.295196 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.295702 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.296789 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.297087 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.297169 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.299810 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.299813 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.299815 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.299841 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.301627 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.302194 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.302198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.302199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.302295 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.302684 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.302687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.302688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.302949 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.303071 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.303572 (+ 501us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.303719 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:52:06.304608 4050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.292617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:39667 (local address 127.0.0.1:54936)
0807 22:52:06.293169 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.293217 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:06.293929 (+ 712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:06.294355 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:06.294360 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:06.294790 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:06.295019 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.295056 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.295810 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.295814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.296661 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.296669 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.297219 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.297223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.297396 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.298003 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:06.298028 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:06.299649 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:06.301733 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.301741 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.301748 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.302093 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.302395 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.302400 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.302402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.302571 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.303073 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:06.303078 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:06.303313 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 22:52:06.303494 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 22:52:06.303786 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"spinlock_wait_cycles":52352,"thread_start_us":149,"threads_started":1}
I20260807 22:52:06.304615 4049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.292617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58028 (local address 127.12.112.252:41405)
0807 22:52:06.293127 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.293145 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.293184 (+ 39us) server_negotiation.cc:407] Connection header received
0807 22:52:06.293929 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.293951 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.294172 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.294373 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.295112 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.296100 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.296981 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.297430 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.297534 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.300271 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.300293 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.300308 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.300334 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.302188 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.302693 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.302699 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.302701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.302778 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.303056 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.303059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.303061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.303311 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.303486 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.303746 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.303876 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":138,"threads_started":1}
I20260807 22:52:06.305745 4046 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143126, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:52:06.313987 4050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.306229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:34025 (local address 127.0.0.1:58290)
0807 22:52:06.306413 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.306429 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:06.306508 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:06.306742 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:06.306745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:06.306930 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:06.307043 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.307051 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.307924 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.307927 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.308418 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.308425 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.308904 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.308907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.309003 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.309504 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:06.309515 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:06.310863 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:06.312543 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.312547 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.312549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.312741 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.313045 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.313048 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.313050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.313132 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.313513 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:06.313516 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:06.313609 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 22:52:06.313715 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 22:52:06.313837 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260807 22:52:06.314054 3974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.306358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58290 (local address 127.12.112.253:34025)
0807 22:52:06.306491 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.306495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.306510 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:52:06.306596 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.306598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.306635 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.306726 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.307172 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.307812 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.308566 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.308794 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.308871 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.311006 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.311017 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.311020 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.311042 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.312406 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.312846 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.312850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.312851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.312932 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.313227 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.313230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.313232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.313406 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.313515 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.313791 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.313906 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:52:06.314788 4046 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:06.315677 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.306978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54940 (local address 127.12.112.254:39667)
0807 22:52:06.307116 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.307122 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.307138 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:52:06.307207 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.307209 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.307255 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.307332 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.307830 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.308402 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.309373 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.309642 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.309722 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.312365 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.312368 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.312371 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.312394 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.313775 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.314273 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.314279 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.314281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.314411 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.314795 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.314802 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.314807 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.315024 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.315220 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.315437 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.315563 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:52:06.315865 3889 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } attempt: 3
I20260807 22:52:06.318749 3968 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } attempt: 3
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143126, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143125, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
I20260807 22:52:06.324702 4050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.315253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:58036)
0807 22:52:06.315376 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.315391 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:06.315458 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:06.316123 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:06.316125 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:06.316241 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:06.316349 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.316357 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.317255 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.317258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.317916 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.317925 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.318550 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.318554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.318634 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.319480 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:06.319493 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:06.320826 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:06.323256 (+ 2430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.323258 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.323260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.323475 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.323724 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.323726 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.323727 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.323819 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.324232 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:06.324235 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:06.324309 (+ 74us) client_negotiation.cc:769] Sending connection context
0807 22:52:06.324407 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 22:52:06.324538 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":3}
I20260807 22:52:06.325289 4049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.315467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58036 (local address 127.12.112.252:41405)
0807 22:52:06.315866 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.315870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.315884 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:52:06.315919 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.315921 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.315952 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.316045 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.316463 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.317147 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.318043 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.318435 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.318533 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.320960 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.320966 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.320969 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.320988 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.323142 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.323563 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.323566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.323568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.323632 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.323901 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.323903 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.323905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.324108 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.324199 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.324997 (+ 798us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.325099 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"spinlock_wait_cycles":2944}
Aug 07 22:52:06 dist-test-slave-tm1g krb5kdc[3806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143126, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
I20260807 22:52:06.329023 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.316361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:58042)
0807 22:52:06.316484 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.316513 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:06.316584 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:06.317366 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:06.317372 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:06.317561 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:06.317666 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.317674 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.319304 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.319310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.320164 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.320175 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.320955 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.320960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.321067 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.321888 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:06.321922 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:06.323783 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:06.326924 (+ 3141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.326928 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.326930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.327219 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.327546 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.327550 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.327554 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.327648 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.328193 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:06.328198 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:06.328307 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 22:52:06.328422 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 22:52:06.328591 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 22:52:06.329159 4046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1: Bootstrap starting.
I20260807 22:52:06.329455 4051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.316734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58042 (local address 127.12.112.252:41405)
0807 22:52:06.317099 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.317105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.317114 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:52:06.317140 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.317142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.317171 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.317323 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.317796 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.319171 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.320326 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.320719 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.320869 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.323935 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.323939 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.323942 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.323976 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.326802 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.327320 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.327324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.327326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.327414 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.327744 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.327749 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.327751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.328014 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.328117 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.328741 (+ 624us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.329247 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":311,"spinlock_wait_cycles":768,"thread_start_us":127,"threads_started":1}
I20260807 22:52:06.329630 3974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.316857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58296 (local address 127.12.112.253:34025)
0807 22:52:06.316966 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.316970 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.317036 (+ 66us) server_negotiation.cc:407] Connection header received
0807 22:52:06.317189 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.317192 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.317240 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.317297 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.318122 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.319121 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.319987 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.320197 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.320300 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.324496 (+ 4196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.324500 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.324504 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.324533 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.327371 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.328209 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.328213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.328214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.328296 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.328625 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.328628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.328630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.328824 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.328992 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.329361 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.329496 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:52:06.331211 3971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.319110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:41405 (local address 127.0.0.1:58056)
0807 22:52:06.319275 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:06.319289 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:06.319351 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:06.321339 (+ 1988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:06.321341 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:06.321515 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:06.321582 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.321587 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.322685 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.322690 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.323617 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:06.323627 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.324239 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.324243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:06.324335 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.324700 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:06.324719 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:06.326617 (+ 1898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:06.329587 (+ 2970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.329592 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.329594 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.329845 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.330193 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:06.330196 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:06.330198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:06.330292 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:06.330765 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:06.330768 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:06.330860 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 22:52:06.330937 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:52:06.331062 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260807 22:52:06.331837 4052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.319199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58056 (local address 127.12.112.252:41405)
0807 22:52:06.321113 (+ 1914us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.321124 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.321138 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:52:06.321173 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.321177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.321219 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.321304 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.321698 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.322547 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.323759 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.324108 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.324521 (+ 413us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.327526 (+ 3005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.327530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.327532 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.327555 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.329456 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.329976 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.329979 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.329980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.330081 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.330441 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.330444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.330446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.330647 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.331479 (+ 832us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.331563 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.331675 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1846,"thread_start_us":105,"threads_started":1}
I20260807 22:52:06.332106 4046 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1: Neither blocks nor log segments found. Creating new log.
I20260807 22:52:06.332543 3889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf: Bootstrap starting.
I20260807 22:52:06.333009 4046 log.cc:824] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1: Log is configured to *not* fsync() on all Append() calls
I20260807 22:52:06.334664 3968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013: Bootstrap starting.
I20260807 22:52:06.334812 3889 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf: Neither blocks nor log segments found. Creating new log.
I20260807 22:52:06.335644 3889 log.cc:824] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf: Log is configured to *not* fsync() on all Append() calls
I20260807 22:52:06.335800 4046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1: No bootstrap required, opened a new log
I20260807 22:52:06.337205 3968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013: Neither blocks nor log segments found. Creating new log.
I20260807 22:52:06.337920 3889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf: No bootstrap required, opened a new log
I20260807 22:52:06.338033 3968 log.cc:824] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013: Log is configured to *not* fsync() on all Append() calls
I20260807 22:52:06.338657 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:52:06.340026 3968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013: No bootstrap required, opened a new log
I20260807 22:52:06.340054 3862 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "be4463b6f73642c0b867a0c2211c9fcf"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54940
I20260807 22:52:06.340742 4046 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } }
I20260807 22:52:06.340986 4046 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fbad228954f4d5c90de84529b1d98d1, State: Initialized, Role: FOLLOWER
I20260807 22:52:06.341315 4046 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } }
I20260807 22:52:06.341917 3889 raft_consensus.cc:348] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } }
I20260807 22:52:06.342108 3889 raft_consensus.cc:729] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be4463b6f73642c0b867a0c2211c9fcf, State: Initialized, Role: FOLLOWER
I20260807 22:52:06.341931 4057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } } }
I20260807 22:52:06.342383 4057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:06.342408 3889 consensus_queue.cc:260] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } }
I20260807 22:52:06.342761 4046 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:52:06.343017 4059 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } } }
I20260807 22:52:06.343299 4059 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:06.343645 3889 sys_catalog.cc:564] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:52:06.343734 3862 raft_consensus.cc:482] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 22:52:06.343860 3862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:52:06.344164 3968 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } }
I20260807 22:52:06.344358 3968 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc5c46417a8a4e32bba198d1d7028013, State: Initialized, Role: FOLLOWER
I20260807 22:52:06.344616 3968 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } }
I20260807 22:52:06.345192 3862 raft_consensus.cc:504] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } }
W20260807 22:52:06.345554 3841 tablet.cc:2369] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:52:06.345830 3968 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:52:06.346163 3862 leader_election.cc:288] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [CANDIDATE]: Term 1 election: Requested vote from peers fc5c46417a8a4e32bba198d1d7028013 (127.12.112.253:34025), 3fbad228954f4d5c90de84529b1d98d1 (127.12.112.252:41405)
I20260807 22:52:06.346657 3941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "be4463b6f73642c0b867a0c2211c9fcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "fc5c46417a8a4e32bba198d1d7028013"
I20260807 22:52:06.346869 3941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:52:06.348801 3941 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be4463b6f73642c0b867a0c2211c9fcf in term 1.
I20260807 22:52:06.349339 3838 leader_election.cc:302] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be4463b6f73642c0b867a0c2211c9fcf, fc5c46417a8a4e32bba198d1d7028013; no voters:
I20260807 22:52:06.349426 4020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "be4463b6f73642c0b867a0c2211c9fcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3fbad228954f4d5c90de84529b1d98d1"
I20260807 22:52:06.349658 4020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:52:06.349707 4059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:52:06.349912 4059 raft_consensus.cc:686] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [term 1 LEADER]: Becoming Leader. State: Replica: be4463b6f73642c0b867a0c2211c9fcf, State: Running, Role: LEADER
W20260807 22:52:06.350086 4083 catalog_manager.cc:1558] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:52:06.350137 4083 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:52:06.350208 4059 consensus_queue.cc:237] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } }
I20260807 22:52:06.351162 4020 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be4463b6f73642c0b867a0c2211c9fcf in term 1.
I20260807 22:52:06.349639 3976 master_runner.cc:186] Error getting master registration for 127.12.112.254:39667: OK, instance_id { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" instance_seqno: 1786143125848893 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:52:06.353720 3976 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 22:52:06.357650 4104 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:52:06.357731 4104 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:52:06.358285 4077 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } } }
I20260807 22:52:06.358430 4077 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:06.359400 4059 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader be4463b6f73642c0b867a0c2211c9fcf. Latest consensus state: current_term: 1 leader_uuid: "be4463b6f73642c0b867a0c2211c9fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } } }
I20260807 22:52:06.359519 4059 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:06.360476 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.349960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54944 (local address 127.12.112.254:39667)
0807 22:52:06.350082 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.350089 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.350714 (+ 625us) server_negotiation.cc:407] Connection header received
0807 22:52:06.350900 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.350903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.350946 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.350993 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.352072 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.352857 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.354132 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.354662 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.354742 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.356616 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.356620 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.356622 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.356647 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.358280 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.358919 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.358923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.358924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.359009 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.359343 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.359346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.359348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.359580 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.359701 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.360181 (+ 480us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.360294 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:52:06.353791 3819 master_runner.cc:186] Error getting master registration for 127.12.112.253:34025: OK, instance_id { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" instance_seqno: 1786143126062930 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:52:06.361260 3819 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:52:06.362983 3974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.350764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58312 (local address 127.12.112.253:34025)
0807 22:52:06.351455 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.351461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.352372 (+ 911us) server_negotiation.cc:407] Connection header received
0807 22:52:06.352569 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.352575 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.352623 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.352675 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.353678 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.354439 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.355716 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.356065 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.356139 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.358049 (+ 1910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.358054 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.358058 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.358091 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.359891 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.360365 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.360368 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.360370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.360450 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.360750 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.360754 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.360756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.360982 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.361077 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.362715 (+ 1638us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.362835 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612}
I20260807 22:52:06.363631 4107 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:52:06.364672 4107 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260807 22:52:06.369397 4076 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:52:06.369553 4076 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:52:06.370209 4020 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [term 1 FOLLOWER]: Refusing update from remote peer be4463b6f73642c0b867a0c2211c9fcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:52:06.370254 3941 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [term 1 FOLLOWER]: Refusing update from remote peer be4463b6f73642c0b867a0c2211c9fcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:52:06.370929 4059 consensus_queue.cc:1035] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:52:06.371111 4090 consensus_queue.cc:1035] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:52:06.373023 4052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:06.351417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58064 (local address 127.12.112.252:41405)
0807 22:52:06.351611 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.351616 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.358121 (+ 6505us) server_negotiation.cc:407] Connection header received
0807 22:52:06.358714 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.358719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.358778 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.358834 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.359760 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.360565 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.367155 (+ 6590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:06.367496 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:06.367600 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:06.369354 (+ 1754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:06.369358 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:06.369360 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:06.369385 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:06.371135 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.371610 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.371614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.371616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.371709 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:06.372060 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:06.372063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:06.372065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:06.372272 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:06.372393 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:06.372759 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 22:52:06.372886 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260807 22:52:06.374904 4057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be4463b6f73642c0b867a0c2211c9fcf. Latest consensus state: current_term: 1 leader_uuid: "be4463b6f73642c0b867a0c2211c9fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } } }
I20260807 22:52:06.375052 4057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:06.375948 4077 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be4463b6f73642c0b867a0c2211c9fcf. Latest consensus state: current_term: 1 leader_uuid: "be4463b6f73642c0b867a0c2211c9fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } } }
I20260807 22:52:06.376068 4077 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:06.378273 4057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "be4463b6f73642c0b867a0c2211c9fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } } }
I20260807 22:52:06.378402 4057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:06.378530 4077 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "be4463b6f73642c0b867a0c2211c9fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } } }
I20260807 22:52:06.378633 4077 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:06.379591 4059 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "be4463b6f73642c0b867a0c2211c9fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } } }
I20260807 22:52:06.379709 4059 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:06.379860 4059 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "be4463b6f73642c0b867a0c2211c9fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be4463b6f73642c0b867a0c2211c9fcf" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 39667 } } peers { permanent_uuid: "fc5c46417a8a4e32bba198d1d7028013" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 34025 } } peers { permanent_uuid: "3fbad228954f4d5c90de84529b1d98d1" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 41405 } } }
I20260807 22:52:06.379947 4059 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:06.380124 4111 mvcc.cc:205] Tried to move back new op lower bound from 7316042245603999744 to 7316042245563994112. Current Snapshot: MvccSnapshot[applied={T|T < 7316042245603999744}]
I20260807 22:52:06.380870 4107 catalog_manager.cc:1347] Generated new cluster ID: 7658b4a88c26431489b7f4a70e4b9017
I20260807 22:52:06.380926 4107 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:52:06.382823 4110 mvcc.cc:205] Tried to move back new op lower bound from 7316042245603999744 to 7316042245563994112. Current Snapshot: MvccSnapshot[applied={T|T < 7316042245603999744}]
I20260807 22:52:06.403481 4107 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:52:06.404680 4107 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:52:06.421638 4107 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be4463b6f73642c0b867a0c2211c9fcf: Generated new TSK 0
I20260807 22:52:06.422458 4107 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:52:06.452816 4052 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.449751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58074 (local address 127.12.112.252:41405)
0807 22:52:06.449878 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.449883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.451757 (+ 1874us) server_negotiation.cc:407] Connection header received
0807 22:52:06.451962 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.451966 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.452015 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.452067 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.452684 (+ 617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58074: BlockingRecv error: recv got EOF from 127.0.0.1:58074 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 22:52:06.454119 3892 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.450229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54948 (local address 127.12.112.254:39667)
0807 22:52:06.450388 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.450392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.453294 (+ 2902us) server_negotiation.cc:407] Connection header received
0807 22:52:06.453453 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.453456 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.453501 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.453548 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.454007 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54948: BlockingRecv error: recv got EOF from 127.0.0.1:54948 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 22:52:06.455670 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.451214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58318 (local address 127.12.112.253:34025)
0807 22:52:06.451322 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.451326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.454510 (+ 3184us) server_negotiation.cc:407] Connection header received
0807 22:52:06.454937 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.454941 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.454991 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.455040 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.455558 (+ 518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58318: BlockingRecv error: recv got EOF from 127.0.0.1:58318 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 22:52:06.459785 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.458271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58320 (local address 127.12.112.253:34025)
0807 22:52:06.458394 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.458398 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.458894 (+ 496us) server_negotiation.cc:407] Connection header received
0807 22:52:06.459098 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.459101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.459166 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.459222 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.459698 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58320: BlockingRecv error: recv got EOF from 127.0.0.1:58320 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260807 22:52:06.467420 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.463354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58330 (local address 127.12.112.253:34025)
0807 22:52:06.463445 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.463449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.466610 (+ 3161us) server_negotiation.cc:407] Connection header received
0807 22:52:06.466782 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.466785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.466840 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.466887 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.467338 (+ 451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58330: BlockingRecv error: recv got EOF from 127.0.0.1:58330 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260807 22:52:06.472715 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.471351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58342 (local address 127.12.112.253:34025)
0807 22:52:06.471435 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.471439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.471916 (+ 477us) server_negotiation.cc:407] Connection header received
0807 22:52:06.472081 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.472084 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.472125 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.472171 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.472618 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58342: BlockingRecv error: recv got EOF from 127.0.0.1:58342 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260807 22:52:06.479965 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.478561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58356 (local address 127.12.112.253:34025)
0807 22:52:06.478680 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.478684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.479173 (+ 489us) server_negotiation.cc:407] Connection header received
0807 22:52:06.479339 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.479342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.479384 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.479431 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.479886 (+ 455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58356: BlockingRecv error: recv got EOF from 127.0.0.1:58356 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260807 22:52:06.491248 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.489735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58360 (local address 127.12.112.253:34025)
0807 22:52:06.489842 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.489846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.490402 (+ 556us) server_negotiation.cc:407] Connection header received
0807 22:52:06.490582 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.490585 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.490630 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.490679 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.491160 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58360: BlockingRecv error: recv got EOF from 127.0.0.1:58360 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260807 22:52:06.511392 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.509540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58368 (local address 127.12.112.253:34025)
0807 22:52:06.509666 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.509672 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.510274 (+ 602us) server_negotiation.cc:407] Connection header received
0807 22:52:06.510527 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.510531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.510600 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.510654 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.511277 (+ 623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58368: BlockingRecv error: recv got EOF from 127.0.0.1:58368 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 22:52:06.547816 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.546044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58384 (local address 127.12.112.253:34025)
0807 22:52:06.546167 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.546172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.546810 (+ 638us) server_negotiation.cc:407] Connection header received
0807 22:52:06.547035 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.547039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.547095 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.547147 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.547706 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58384: BlockingRecv error: recv got EOF from 127.0.0.1:58384 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 22:52:06.615298 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.614220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58388 (local address 127.12.112.253:34025)
0807 22:52:06.614389 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.614393 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.614517 (+ 124us) server_negotiation.cc:407] Connection header received
0807 22:52:06.614637 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.614640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.614688 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.614771 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.615165 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58388: BlockingRecv error: recv got EOF from 127.0.0.1:58388 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260807 22:52:06.747088 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:06.745758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58392 (local address 127.12.112.253:34025)
0807 22:52:06.745917 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:06.745923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:06.746108 (+ 185us) server_negotiation.cc:407] Connection header received
0807 22:52:06.746294 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:06.746334 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:06.746394 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:06.746483 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:06.746953 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58392: BlockingRecv error: recv got EOF from 127.0.0.1:58392 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 22:52:07.006595 3974 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:07.005438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58408 (local address 127.12.112.253:34025)
0807 22:52:07.005584 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:07.005592 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:07.005647 (+ 55us) server_negotiation.cc:407] Connection header received
0807 22:52:07.005837 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:07.005840 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:07.005896 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:07.005985 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:07.006472 (+ 487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58408: BlockingRecv error: recv got EOF from 127.0.0.1:58408 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:52:07.359021 4104 catalog_manager.cc:1259] Loaded cluster ID: 7658b4a88c26431489b7f4a70e4b9017
I20260807 22:52:07.359108 4104 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013: loading cluster ID for follower catalog manager: success
I20260807 22:52:07.360718 4104 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013: acquiring CA information for follower catalog manager: success
I20260807 22:52:07.361832 4104 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fc5c46417a8a4e32bba198d1d7028013: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:52:07.370678 4076 catalog_manager.cc:1259] Loaded cluster ID: 7658b4a88c26431489b7f4a70e4b9017
I20260807 22:52:07.370759 4076 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1: loading cluster ID for follower catalog manager: success
I20260807 22:52:07.372255 4076 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1: acquiring CA information for follower catalog manager: success
I20260807 22:52:07.373301 4076 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3fbad228954f4d5c90de84529b1d98d1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:52:07.524718 4186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:07.520959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58424 (local address 127.12.112.253:34025)
0807 22:52:07.521203 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:07.521207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:07.521260 (+ 53us) server_negotiation.cc:407] Connection header received
0807 22:52:07.521412 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:07.521415 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:07.521547 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:07.521654 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:52:07.521927 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:07.522489 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:07.523367 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:07.523588 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:07.523662 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:07.523948 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:52:07.524388 (+ 440us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:52:07.524479 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:07.524535 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 22:52:07.524586 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":94,"threads_started":1}
I20260807 22:52:07.531448 4192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:07.527891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58076 (local address 127.12.112.252:41405)
0807 22:52:07.528175 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:07.528180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:07.528198 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:52:07.528295 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:07.528298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:07.528413 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:07.528518 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:52:07.528741 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:07.529273 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:07.530049 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:07.530264 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:07.530405 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:07.530698 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:52:07.531121 (+ 423us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:52:07.531211 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:07.531267 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 22:52:07.531317 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":103,"threads_started":1}
I20260807 22:52:07.538838 4192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:07.534727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58082 (local address 127.12.112.252:41405)
0807 22:52:07.534840 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:07.534844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:07.535100 (+ 256us) server_negotiation.cc:407] Connection header received
0807 22:52:07.535153 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:07.535156 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:07.535207 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:07.535285 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:52:07.535581 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:07.536311 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:07.537480 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:07.537825 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:07.537924 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:07.538271 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:52:07.538378 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:52:07.538452 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:07.538615 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 22:52:07.538677 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 22:52:07.539156 4186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:07.535063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58434 (local address 127.12.112.253:34025)
0807 22:52:07.535193 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:07.535196 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:07.535430 (+ 234us) server_negotiation.cc:407] Connection header received
0807 22:52:07.535653 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:07.535656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:07.535703 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:07.535779 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:52:07.536061 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:07.536807 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:07.537907 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:07.538193 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:07.538286 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:07.538657 (+ 371us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:52:07.538744 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:52:07.538793 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:07.538954 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 22:52:07.539015 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:52:07.539989 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:07.534950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54958 (local address 127.12.112.254:39667)
0807 22:52:07.535516 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:07.535536 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:07.535552 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:52:07.535645 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:07.535647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:07.535801 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:07.535916 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:52:07.536153 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:07.536862 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:07.538091 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:07.538480 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:07.538596 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:07.538875 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:52:07.539590 (+ 715us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:52:07.539689 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:07.539773 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 22:52:07.539834 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":69,"threads_started":1}
I20260807 22:52:07.543133 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 3819
I20260807 22:52:07.552846 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 3896
I20260807 22:52:07.559932 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 3976
2026-08-07T22:52:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3073 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:52:07 dist-test-slave-tm1g krb5kdc[4204](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:52:07 dist-test-slave-tm1g krb5kdc[4204](info): set up 2 sockets
Aug 07 22:52:07 dist-test-slave-tm1g krb5kdc[4204](info): commencing operation
krb5kdc: starting...
W20260807 22:52:08.630789 12739 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/test-user.keytab.
Aug 07 22:52:08 dist-test-slave-tm1g krb5kdc[4204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:52:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:52:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.112.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
Entry for principal kudu/127.12.112.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab.
I20260807 22:52:08.751298 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:38469
--webserver_interface=127.12.112.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:38469,127.12.112.253:33667,127.12.112.252:42089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:52:08.861009 4219 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:52:08.861265 4219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:52:08.861289 4219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:52:08.861325 4219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:52:08.865276 4219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:52:08.865336 4219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:52:08.865355 4219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:52:08.865411 4219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:52:08.865449 4219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:52:08.870575 4219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:38469,127.12.112.253:33667,127.12.112.252:42089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.254.keytab
--principal=kudu/127.12.112.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.254:38469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.112.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:52:08.871547 4219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:52:08.872539 4219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:52:08.880921 4225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:08.880931 4228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:08.881002 4219 server_base.cc:1034] running on GCE node
W20260807 22:52:08.880970 4226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:08.881803 4219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:52:08.882907 4219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:52:08.884094 4219 hybrid_clock.cc:648] HybridClock initialized: now 1786143128884080 us; error 27 us; skew 500 ppm
Aug 07 22:52:08 dist-test-slave-tm1g krb5kdc[4204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143128, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:52:08.886973 4219 init.cc:377] Logged in from keytab as kudu/127.12.112.254@KRBTEST.COM (short username kudu)
I20260807 22:52:08.887799 4219 webserver.cc:460] Webserver started at http://127.12.112.254:41231/ using document root <none> and password file <none>
I20260807 22:52:08.888327 4219 fs_manager.cc:359] Metadata directory not provided
I20260807 22:52:08.888412 4219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:52:08.888638 4219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:52:08.891018 4219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/data/instance:
uuid: "a92bb089b2a742d9956f0cba5b711655"
format_stamp: "Formatted at 2026-08-07 22:52:08 on dist-test-slave-tm1g"
server_key: "cdaa552be5b4cd44de053fb8cd28e23e"
server_key_iv: "c0e3235305f3e28c0f73db9fb89aac9d"
server_key_version: "encryptionkey@0"
I20260807 22:52:08.891563 4219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/wal/instance:
uuid: "a92bb089b2a742d9956f0cba5b711655"
format_stamp: "Formatted at 2026-08-07 22:52:08 on dist-test-slave-tm1g"
server_key: "cdaa552be5b4cd44de053fb8cd28e23e"
server_key_iv: "c0e3235305f3e28c0f73db9fb89aac9d"
server_key_version: "encryptionkey@0"
I20260807 22:52:08.895074 4219 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:52:08.897306 4235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:52:08.898464 4219 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:52:08.898777 4219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/wal
uuid: "a92bb089b2a742d9956f0cba5b711655"
format_stamp: "Formatted at 2026-08-07 22:52:08 on dist-test-slave-tm1g"
server_key: "cdaa552be5b4cd44de053fb8cd28e23e"
server_key_iv: "c0e3235305f3e28c0f73db9fb89aac9d"
server_key_version: "encryptionkey@0"
I20260807 22:52:08.898896 4219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:52:08.919520 4219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:52:08.922701 4219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:52:08.922895 4219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:52:08.929699 4219 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.254:38469
I20260807 22:52:08.929975 4289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.254:38469 every 8 connection(s)
I20260807 22:52:08.930649 4219 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/data/info.pb
I20260807 22:52:08.933262 4290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:52:08.936898 4290 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:08.937295 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 4219
I20260807 22:52:08.937426 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-0/wal/instance
I20260807 22:52:08.937691 12739 external_mini_cluster.cc:1428] Setting key e7807f01cf9ee76ef42f1592e702c814
WARNING: no policy specified for kudu/127.12.112.253@KRBTEST.COM; defaulting to no policy
Aug 07 22:52:08 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143128, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.253@KRBTEST.COM" created.
I20260807 22:52:08.952709 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:08.939157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:38469 (local address 127.0.0.1:59640)
0807 22:52:08.939613 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:08.939671 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:08.940477 (+ 806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:08.941236 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:08.941244 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:08.941728 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:08.942131 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:08.942153 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:08.943416 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:08.943422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:08.944734 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:08.944747 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:08.945423 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:08.945434 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:08.945570 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:08.946162 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:08.946186 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:08.947886 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:08.949819 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:08.949828 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:08.949836 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:08.950104 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:08.950474 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:08.950480 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:08.950485 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:08.950638 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:08.951193 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:08.951202 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:08.951367 (+ 165us) client_negotiation.cc:769] Sending connection context
0807 22:52:08.951560 (+ 193us) client_negotiation.cc:240] Negotiation successful
0807 22:52:08.951951 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":49,"thread_start_us":138,"threads_started":1}
I20260807 22:52:08.952714 4293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:08.939157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59640 (local address 127.12.112.254:38469)
0807 22:52:08.939898 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:08.939911 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:08.939958 (+ 47us) server_negotiation.cc:407] Connection header received
0807 22:52:08.940777 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:08.940785 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:08.941022 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:08.941170 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:08.942341 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:08.943278 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:08.944861 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:08.945246 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:08.945372 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:08.948031 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:08.948036 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:08.948045 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:08.948065 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:08.949702 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:08.950218 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:08.950223 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:08.950224 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:08.950380 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:08.950731 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:08.950733 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:08.950734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:08.951082 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:08.951184 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:08.951659 (+ 475us) server_negotiation.cc:299] Negotiation successful
0807 22:52:08.952057 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":133,"server-negotiator.queue_time_us":612,"spinlock_wait_cycles":12160,"thread_start_us":153,"threads_started":1}
I20260807 22:52:08.955176 4290 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:08.955884 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:08.955660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:33667 (local address 127.0.0.1:59160)
0807 22:52:08.955769 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:08.955832 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:33667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 22:52:08.956055 4239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.112.253:33667: connect: Connection refused (error 111)
I20260807 22:52:08.956902 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:08.956709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:33667 (local address 127.0.0.1:59162)
0807 22:52:08.956807 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:08.956855 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:33667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 22:52:08.957052 4290 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.253:33667: Network error: Client connection negotiation failed: client connection to 127.12.112.253:33667: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab.
Entry for principal kudu/127.12.112.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab.
I20260807 22:52:08.965059 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.253:33667
--webserver_interface=127.12.112.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab
--principal=kudu/127.12.112.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:38469,127.12.112.253:33667,127.12.112.252:42089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:52:09.006349 4290 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } attempt: 1
I20260807 22:52:09.007266 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.006904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:33667 (local address 127.0.0.1:59178)
0807 22:52:09.007093 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.007170 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:33667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 22:52:09.008014 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.007778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:33667 (local address 127.0.0.1:59184)
0807 22:52:09.007884 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.007938 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:33667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 22:52:09.008162 4290 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.253:33667: Network error: Client connection negotiation failed: client connection to 127.12.112.253:33667: connect: Connection refused (error 111)
W20260807 22:52:09.075196 4297 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:52:09.075462 4297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:52:09.075486 4297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:52:09.075536 4297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 22:52:09.076336 4290 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } attempt: 2
I20260807 22:52:09.077219 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.076880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:33667 (local address 127.0.0.1:59198)
0807 22:52:09.077056 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.077126 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:33667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 22:52:09.078042 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.077820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:33667 (local address 127.0.0.1:59214)
0807 22:52:09.077918 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.077970 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.253:33667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 22:52:09.078172 4290 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.253:33667: Network error: Client connection negotiation failed: client connection to 127.12.112.253:33667: connect: Connection refused (error 111)
W20260807 22:52:09.080147 4297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:52:09.080196 4297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:52:09.080216 4297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:52:09.080232 4297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:52:09.080247 4297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:52:09.085373 4297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:38469,127.12.112.253:33667,127.12.112.252:42089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.253.keytab
--principal=kudu/127.12.112.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.253:33667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.112.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:52:09.086347 4297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:52:09.087307 4297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:52:09.095506 4303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:09.095563 4297 server_base.cc:1034] running on GCE node
W20260807 22:52:09.095535 4304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:09.095502 4306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:09.096230 4297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:52:09.097285 4297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:52:09.098459 4297 hybrid_clock.cc:648] HybridClock initialized: now 1786143129098430 us; error 38 us; skew 500 ppm
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143129, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:52:09.101001 4297 init.cc:377] Logged in from keytab as kudu/127.12.112.253@KRBTEST.COM (short username kudu)
I20260807 22:52:09.101897 4297 webserver.cc:460] Webserver started at http://127.12.112.253:40857/ using document root <none> and password file <none>
I20260807 22:52:09.102509 4297 fs_manager.cc:359] Metadata directory not provided
I20260807 22:52:09.102602 4297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:52:09.102828 4297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:52:09.104776 4297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/data/instance:
uuid: "3b57812ae9f94ee8a7dfb9962afb9005"
format_stamp: "Formatted at 2026-08-07 22:52:09 on dist-test-slave-tm1g"
server_key: "18370c4dc7153e0eb721c6f01c5f0d7c"
server_key_iv: "7696dd8330b5290cc5089d9448c50271"
server_key_version: "encryptionkey@0"
I20260807 22:52:09.105358 4297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/wal/instance:
uuid: "3b57812ae9f94ee8a7dfb9962afb9005"
format_stamp: "Formatted at 2026-08-07 22:52:09 on dist-test-slave-tm1g"
server_key: "18370c4dc7153e0eb721c6f01c5f0d7c"
server_key_iv: "7696dd8330b5290cc5089d9448c50271"
server_key_version: "encryptionkey@0"
I20260807 22:52:09.108969 4297 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 22:52:09.111296 4315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:52:09.112465 4297 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:52:09.112602 4297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/wal
uuid: "3b57812ae9f94ee8a7dfb9962afb9005"
format_stamp: "Formatted at 2026-08-07 22:52:09 on dist-test-slave-tm1g"
server_key: "18370c4dc7153e0eb721c6f01c5f0d7c"
server_key_iv: "7696dd8330b5290cc5089d9448c50271"
server_key_version: "encryptionkey@0"
I20260807 22:52:09.112706 4297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:52:09.148058 4297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:52:09.151005 4297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:52:09.151211 4297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:52:09.158161 4297 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.253:33667
I20260807 22:52:09.158455 4368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.253:33667 every 8 connection(s)
I20260807 22:52:09.159189 4297 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/data/info.pb
I20260807 22:52:09.161155 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 4297
I20260807 22:52:09.161291 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-1/wal/instance
I20260807 22:52:09.161568 12739 external_mini_cluster.cc:1428] Setting key 321d2667ed3f14249d0becda36752756
I20260807 22:52:09.162007 4369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:52:09.165604 4369 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:09.169324 4290 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } attempt: 3
WARNING: no policy specified for kudu/127.12.112.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.112.252@KRBTEST.COM" created.
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143128, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143129, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:52:09.181980 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.169766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:33667 (local address 127.0.0.1:59230)
0807 22:52:09.169874 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.169889 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:09.169959 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:09.170798 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:09.170801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:09.171102 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:09.171236 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.171244 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.172622 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.172628 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.173362 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.173376 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.174337 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.174341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.174441 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.174974 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:09.174985 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:09.177327 (+ 2342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:09.179769 (+ 2442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.179774 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.179777 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.180184 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.180537 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.180540 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.180542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.180640 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.181458 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:09.181461 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:09.181552 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 22:52:09.181663 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:52:09.181803 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":22}
I20260807 22:52:09.182127 4293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.167649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59648 (local address 127.12.112.254:38469)
0807 22:52:09.167812 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.167817 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.168638 (+ 821us) server_negotiation.cc:407] Connection header received
0807 22:52:09.169635 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.169645 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.169707 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.169802 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.171249 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.171832 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.173136 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.173963 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.174117 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.178074 (+ 3957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.178080 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.178085 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.178116 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.180113 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.180613 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.180616 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.180618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.180702 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.181034 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.181039 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.181041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.181222 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.181323 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.181760 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.181892 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":59}
I20260807 22:52:09.182994 4374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.170130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59230 (local address 127.12.112.253:33667)
0807 22:52:09.170426 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.170441 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.170461 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:52:09.170503 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.170507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.170653 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.170811 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.171356 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.172512 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.173488 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.174141 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.174404 (+ 263us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.177468 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.177473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.177483 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.177506 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.179649 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.180295 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.180302 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.180304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.180426 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.180769 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.180775 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.180778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.181346 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.181486 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.182128 (+ 642us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.182262 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":208,"spinlock_wait_cycles":896,"thread_start_us":119,"threads_started":1}
I20260807 22:52:09.182998 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.168018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:38469 (local address 127.0.0.1:59648)
0807 22:52:09.168468 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.168519 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:09.169370 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:09.170113 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:09.170122 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:09.170555 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:09.171115 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.171131 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.171965 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.171969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.173006 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.173018 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.174250 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.174254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.174411 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.175204 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:09.175225 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:09.177920 (+ 2695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:09.180220 (+ 2300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.180229 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.180240 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.180535 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.180796 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.180800 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.180802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.180932 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.181325 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:09.181333 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:09.181502 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 22:52:09.181676 (+ 174us) client_negotiation.cc:240] Negotiation successful
0807 22:52:09.181971 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":26,"thread_start_us":132,"threads_started":1}
I20260807 22:52:09.184353 4369 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:09.184957 4290 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:09.185616 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.185365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52198)
0807 22:52:09.185473 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.185547 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 22:52:09.186553 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.186197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52200)
0807 22:52:09.186407 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.186469 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
W20260807 22:52:09.186721 4290 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:42089: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.112.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab.
Entry for principal kudu/127.12.112.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab.
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143129, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
I20260807 22:52:09.189641 12739 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
/tmp/dist-test-tasksZtO5S/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.252:42089
--webserver_interface=127.12.112.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab
--principal=kudu/127.12.112.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.112.212:40069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.112.254:38469,127.12.112.253:33667,127.12.112.252:42089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:52:09.192921 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.184854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:33667 (local address 127.0.0.1:59238)
0807 22:52:09.185008 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.185027 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:09.185113 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:09.185566 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:09.185569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:09.185768 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:09.185893 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.185901 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.186875 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.186878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.187432 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.187441 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.187875 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.187877 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.187950 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.188366 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:09.188377 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:09.189715 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:09.191555 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.191561 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.191564 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.191744 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.192009 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.192013 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.192015 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.192090 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.192439 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:09.192443 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:09.192530 (+ 87us) client_negotiation.cc:769] Sending connection context
0807 22:52:09.192630 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 22:52:09.192759 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260807 22:52:09.192945 4374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.184924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59238 (local address 127.12.112.253:33667)
0807 22:52:09.185318 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.185322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.185335 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:52:09.185400 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.185402 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.185447 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.185532 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.186013 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.186751 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.187528 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.187783 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.187859 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.189863 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.189869 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.189875 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.189903 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.191447 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.191835 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.191840 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.191842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.191917 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.192179 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.192182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.192184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.192344 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.192439 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.192673 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.192816 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":304}
I20260807 22:52:09.193610 4369 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:09.194257 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.194025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52208)
0807 22:52:09.194126 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.194199 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 22:52:09.195050 4317 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
I20260807 22:52:09.195883 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.195700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52212)
0807 22:52:09.195794 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.195835 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 22:52:09.196100 4369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:42089: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
I20260807 22:52:09.217857 4290 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } attempt: 1
I20260807 22:52:09.218672 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.218358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52218)
0807 22:52:09.218506 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.218573 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 22:52:09.219379 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.219155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52232)
0807 22:52:09.219264 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.219318 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 22:52:09.219515 4290 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:42089: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
I20260807 22:52:09.245339 4369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } attempt: 1
I20260807 22:52:09.246193 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.245903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52238)
0807 22:52:09.246050 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.246114 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 22:52:09.246923 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.246712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52250)
0807 22:52:09.246823 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.246872 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 22:52:09.247047 4369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:42089: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
I20260807 22:52:09.294677 4290 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } attempt: 2
I20260807 22:52:09.295539 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.295206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52256)
0807 22:52:09.295372 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.295445 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 22:52:09.296268 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.296038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52272)
0807 22:52:09.296149 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.296203 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 22:52:09.296401 4290 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:42089: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
W20260807 22:52:09.302634 4376 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:52:09.303006 4376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:52:09.303071 4376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:52:09.303211 4376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:52:09.311079 4376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:52:09.311149 4376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:52:09.311185 4376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:52:09.311223 4376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:52:09.311259 4376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:52:09.315194 4369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } attempt: 2
I20260807 22:52:09.316002 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.315703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52282)
0807 22:52:09.315850 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.315911 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 22:52:09.316726 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.316514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52288)
0807 22:52:09.316621 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.316673 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 22:52:09.316860 4369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.112.252:42089: Network error: Client connection negotiation failed: client connection to 127.12.112.252:42089: connect: Connection refused (error 111)
I20260807 22:52:09.319283 4376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.112.212:40069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.112.254:38469,127.12.112.253:33667,127.12.112.252:42089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/krb5kdc/kudu_127.12.112.252.keytab
--principal=kudu/127.12.112.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.112.252:42089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.112.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:52:09.320245 4376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:52:09.321166 4376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:52:09.329226 4382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:09.329242 4385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:52:09.329238 4383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:52:09.329506 4376 server_base.cc:1034] running on GCE node
I20260807 22:52:09.330111 4376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:52:09.331214 4376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:52:09.332398 4376 hybrid_clock.cc:648] HybridClock initialized: now 1786143129332388 us; error 26 us; skew 500 ppm
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143129, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:52:09.335023 4376 init.cc:377] Logged in from keytab as kudu/127.12.112.252@KRBTEST.COM (short username kudu)
I20260807 22:52:09.335845 4376 webserver.cc:460] Webserver started at http://127.12.112.252:39317/ using document root <none> and password file <none>
I20260807 22:52:09.336344 4376 fs_manager.cc:359] Metadata directory not provided
I20260807 22:52:09.336400 4376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:52:09.336556 4376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:52:09.338521 4376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/data/instance:
uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2"
format_stamp: "Formatted at 2026-08-07 22:52:09 on dist-test-slave-tm1g"
server_key: "61ce4a631ab5a1da11cdf15248869f2f"
server_key_iv: "033fab56bff8a75aceb3277a4acf1f01"
server_key_version: "encryptionkey@0"
I20260807 22:52:09.339035 4376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/wal/instance:
uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2"
format_stamp: "Formatted at 2026-08-07 22:52:09 on dist-test-slave-tm1g"
server_key: "61ce4a631ab5a1da11cdf15248869f2f"
server_key_iv: "033fab56bff8a75aceb3277a4acf1f01"
server_key_version: "encryptionkey@0"
I20260807 22:52:09.342504 4376 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:52:09.344730 4392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:52:09.345963 4376 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:52:09.346068 4376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/data,/tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/wal
uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2"
format_stamp: "Formatted at 2026-08-07 22:52:09 on dist-test-slave-tm1g"
server_key: "61ce4a631ab5a1da11cdf15248869f2f"
server_key_iv: "033fab56bff8a75aceb3277a4acf1f01"
server_key_version: "encryptionkey@0"
I20260807 22:52:09.346148 4376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:52:09.356516 4376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:52:09.359213 4376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:52:09.359369 4376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:52:09.366964 4376 rpc_server.cc:307] RPC server started. Bound to: 127.12.112.252:42089
I20260807 22:52:09.367228 4447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.112.252:42089 every 8 connection(s)
I20260807 22:52:09.367901 4376 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/data/info.pb
I20260807 22:52:09.370492 4448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:52:09.374020 4448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:09.375952 12739 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu as pid 4376
I20260807 22:52:09.376096 12739 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksZtO5S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142843719124-12739-0/minicluster-data/master-2/wal/instance
I20260807 22:52:09.376374 12739 external_mini_cluster.cc:1428] Setting key 4be46049309f8bf03be7db7862acb505
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143129, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
I20260807 22:52:09.387756 4293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.375819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59660 (local address 127.12.112.254:38469)
0807 22:52:09.375989 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.375994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.376881 (+ 887us) server_negotiation.cc:407] Connection header received
0807 22:52:09.377885 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.377889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.377949 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.378047 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.378860 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.379370 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.380337 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.380579 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.380688 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.383580 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.383588 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.383590 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.383613 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.385167 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.385879 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.385884 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.385886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.385970 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.386368 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.386372 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.386373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.386607 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.386697 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.387295 (+ 598us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.387422 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 22:52:09.388482 4450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.376223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.254:38469 (local address 127.0.0.1:59660)
0807 22:52:09.376737 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.376778 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:09.377689 (+ 911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:09.378117 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:09.378123 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:09.378493 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:09.378722 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.378734 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.379474 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.379480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.380216 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.380225 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.380722 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.380726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.380978 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.381573 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:09.381594 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:09.383433 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:09.385285 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.385294 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.385305 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.385737 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.386068 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.386071 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.386072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.386236 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.386701 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:09.386706 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:09.387052 (+ 346us) client_negotiation.cc:769] Sending connection context
0807 22:52:09.387220 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 22:52:09.387519 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":90,"spinlock_wait_cycles":2944,"thread_start_us":127,"threads_started":1}
I20260807 22:52:09.388482 4452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.377207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52294 (local address 127.12.112.252:42089)
0807 22:52:09.377505 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.377518 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.377559 (+ 41us) server_negotiation.cc:407] Connection header received
0807 22:52:09.377687 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.377701 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.377883 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.378057 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.378948 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.379785 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.380649 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.381086 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.381195 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.384004 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.384010 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.384017 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.384038 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.385745 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.386219 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.386226 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.386227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.386354 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.386600 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.386602 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.386603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.387055 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.387258 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.387501 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.387616 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":198,"spinlock_wait_cycles":11776,"thread_start_us":87,"threads_started":1}
I20260807 22:52:09.390202 4448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143129, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.254@KRBTEST.COM
I20260807 22:52:09.395555 4290 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } attempt: 3
I20260807 22:52:09.399134 4450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.390724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.253:33667 (local address 127.0.0.1:59254)
0807 22:52:09.390936 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.390950 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:09.391031 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:09.391264 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:09.391267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:09.391432 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:09.391513 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.391518 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.392231 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.392234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.392729 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.392736 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.393211 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.393215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.393308 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.393675 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:09.393686 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:09.395266 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:09.397569 (+ 2303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.397573 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.397575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.397821 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.398160 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.398164 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.398166 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.398252 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.398659 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:09.398664 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:09.398752 (+ 88us) client_negotiation.cc:769] Sending connection context
0807 22:52:09.398853 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 22:52:09.398979 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156}
I20260807 22:52:09.399166 4374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.390826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59254 (local address 127.12.112.253:33667)
0807 22:52:09.390936 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.390942 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.390994 (+ 52us) server_negotiation.cc:407] Connection header received
0807 22:52:09.391119 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.391122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.391170 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.391252 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.391633 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.392116 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.392863 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.393101 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.393209 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.395430 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.395436 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.395442 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.395474 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.397457 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.397970 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.397973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.397976 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.398062 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.398369 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.398374 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.398376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.398552 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.398657 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.398929 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.399031 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 22:52:09.399998 4448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:52:09.400081 4293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.390753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59662 (local address 127.12.112.254:38469)
0807 22:52:09.390854 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.390858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.390934 (+ 76us) server_negotiation.cc:407] Connection header received
0807 22:52:09.391044 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.391047 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.391092 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.391170 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.391732 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.392185 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.392917 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.393125 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.393226 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.395494 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.395496 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.395498 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.395519 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.397456 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.397863 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.397866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.397868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.397971 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.398276 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.398280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.398281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.398548 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.398752 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.399837 (+ 1085us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.399950 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143128, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.254@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143129, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.252@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
I20260807 22:52:09.406211 4452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.396169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52304 (local address 127.12.112.252:42089)
0807 22:52:09.396319 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.396325 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.396342 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:52:09.396381 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.396387 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.396432 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.396533 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.397596 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.398362 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.399248 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.399612 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.400092 (+ 480us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.401945 (+ 1853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.401949 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.401951 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.401977 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.404484 (+ 2507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.404963 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.404967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.404968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.405067 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.405390 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.405392 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.405393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.405544 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.405647 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.405913 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.406033 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:52:09.406682 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.395980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52304)
0807 22:52:09.396125 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.396141 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:09.396217 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:09.396546 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:09.396549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:09.396712 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:09.396782 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.396787 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.398480 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.398483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.399093 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.399102 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.399770 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.399774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.399873 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.400355 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:09.400366 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:09.401799 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:09.404610 (+ 2811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.404613 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.404616 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.404861 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.405191 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.405194 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.405196 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.405295 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.405641 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:09.405644 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:09.405743 (+ 99us) client_negotiation.cc:769] Sending connection context
0807 22:52:09.405858 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 22:52:09.405993 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.112.253@KRBTEST.COM
I20260807 22:52:09.409348 4369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } attempt: 3
I20260807 22:52:09.410373 4450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.400462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52308)
0807 22:52:09.400981 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.400994 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:09.401084 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:09.401574 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:09.401577 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:09.401745 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:09.401838 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.401848 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.402938 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.402943 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.403582 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.403591 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.404044 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.404047 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.404120 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.404515 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:09.404526 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:09.405956 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:09.408703 (+ 2747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.408705 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.408707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.408954 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.409231 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.409234 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.409236 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.409319 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.409806 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:09.409809 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:09.409910 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 22:52:09.410021 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:52:09.410148 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455}
I20260807 22:52:09.410995 4453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.400542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52308 (local address 127.12.112.252:42089)
0807 22:52:09.400871 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.400881 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.401062 (+ 181us) server_negotiation.cc:407] Connection header received
0807 22:52:09.401388 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.401394 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.401452 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.401559 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.402006 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.402844 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.403685 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.403937 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.404035 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.406090 (+ 2055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.406093 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.406096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.406122 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.408588 (+ 2466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.409049 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.409052 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.409054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.409132 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.409423 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.409426 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.409428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.409670 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.409768 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.410688 (+ 920us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.410794 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":105,"threads_started":1}
I20260807 22:52:09.412406 4290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655: Bootstrap starting.
I20260807 22:52:09.413084 4374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.401812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59256 (local address 127.12.112.253:33667)
0807 22:52:09.401930 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.401933 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.401947 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:52:09.401979 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.401982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.402025 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.402109 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.402921 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.403990 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.405177 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.405547 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.405659 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.409043 (+ 3384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.409046 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.409049 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.409102 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.411189 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.411689 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.411695 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.411697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.411780 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.412100 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.412103 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.412104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.412302 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.412489 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.412821 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.412936 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:52:09.413838 4448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2: Bootstrap starting.
I20260807 22:52:09.415308 4290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655: Neither blocks nor log segments found. Creating new log.
Aug 07 22:52:09 dist-test-slave-tm1g krb5kdc[4204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786143129, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.112.253@KRBTEST.COM for kudu/127.12.112.252@KRBTEST.COM
I20260807 22:52:09.416299 4448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2: Neither blocks nor log segments found. Creating new log.
I20260807 22:52:09.416302 4290 log.cc:824] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655: Log is configured to *not* fsync() on all Append() calls
I20260807 22:52:09.417130 4448 log.cc:824] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2: Log is configured to *not* fsync() on all Append() calls
I20260807 22:52:09.418707 4290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655: No bootstrap required, opened a new log
I20260807 22:52:09.419620 12739 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:52:09.419831 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.410238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.112.252:42089 (local address 127.0.0.1:52312)
0807 22:52:09.410727 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0807 22:52:09.410741 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:52:09.410808 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:52:09.411715 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:52:09.411718 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:52:09.411907 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:52:09.412005 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.412013 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.412999 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.413002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.413732 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:52:09.413741 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.414360 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.414365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:52:09.414446 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.414881 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:52:09.414898 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:52:09.416182 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:52:09.418275 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.418280 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.418283 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.418565 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.418873 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:52:09.418877 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:52:09.418879 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:52:09.418961 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:52:09.419412 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:52:09.419415 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:52:09.419515 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 22:52:09.419600 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 22:52:09.419720 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407}
I20260807 22:52:09.420368 4453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.410431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52312 (local address 127.12.112.252:42089)
0807 22:52:09.411497 (+ 1066us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.411502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.411515 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:52:09.411548 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.411551 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.411593 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.412114 (+ 521us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.412202 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.412882 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.413887 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.414198 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.414662 (+ 464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.416304 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.416308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.416310 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.416333 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.418157 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.418680 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.418683 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.418685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.418771 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.419060 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.419063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.419065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.419280 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.420094 (+ 814us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.420167 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.420265 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1004}
I20260807 22:52:09.420858 4262 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a92bb089b2a742d9956f0cba5b711655"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59662
I20260807 22:52:09.422261 4448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2: No bootstrap required, opened a new log
I20260807 22:52:09.423237 4369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005: Bootstrap starting.
I20260807 22:52:09.423120 4290 raft_consensus.cc:348] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } }
I20260807 22:52:09.423322 4290 raft_consensus.cc:729] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92bb089b2a742d9956f0cba5b711655, State: Initialized, Role: FOLLOWER
I20260807 22:52:09.423632 4290 consensus_queue.cc:260] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } }
I20260807 22:52:09.424126 4456 sys_catalog.cc:455] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } } }
I20260807 22:52:09.424343 4456 sys_catalog.cc:458] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:09.425197 4290 sys_catalog.cc:564] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:52:09.425302 4262 raft_consensus.cc:482] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 22:52:09.425397 4262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:52:09.425734 4369 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005: Neither blocks nor log segments found. Creating new log.
I20260807 22:52:09.426213 4448 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } }
I20260807 22:52:09.426491 4448 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76ed184be9ef4b6f9d2e5ffa96dc3da2, State: Initialized, Role: FOLLOWER
I20260807 22:52:09.426584 4369 log.cc:824] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005: Log is configured to *not* fsync() on all Append() calls
I20260807 22:52:09.426790 4262 raft_consensus.cc:504] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } }
I20260807 22:52:09.426786 4448 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } }
I20260807 22:52:09.427748 4262 leader_election.cc:288] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [CANDIDATE]: Term 1 election: Requested vote from peers 3b57812ae9f94ee8a7dfb9962afb9005 (127.12.112.253:33667), 76ed184be9ef4b6f9d2e5ffa96dc3da2 (127.12.112.252:42089)
I20260807 22:52:09.428074 4448 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:52:09.428617 4369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005: No bootstrap required, opened a new log
I20260807 22:52:09.430002 4420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a92bb089b2a742d9956f0cba5b711655" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2"
I20260807 22:52:09.430204 4420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [term 0 FOLLOWER]: Advancing to term 1
W20260807 22:52:09.431028 4469 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:52:09.431097 4469 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:52:09.432128 4420 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92bb089b2a742d9956f0cba5b711655 in term 1.
I20260807 22:52:09.433171 4237 leader_election.cc:302] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76ed184be9ef4b6f9d2e5ffa96dc3da2, a92bb089b2a742d9956f0cba5b711655; no voters:
I20260807 22:52:09.433591 4369 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } }
I20260807 22:52:09.433887 4369 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b57812ae9f94ee8a7dfb9962afb9005, State: Initialized, Role: FOLLOWER
I20260807 22:52:09.434231 4369 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } }
I20260807 22:52:09.435585 4369 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:52:09.435716 4342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a92bb089b2a742d9956f0cba5b711655" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3b57812ae9f94ee8a7dfb9962afb9005"
I20260807 22:52:09.435950 4342 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:52:09.432900 4219 master_runner.cc:186] Error getting master registration for 127.12.112.253:33667: OK, instance_id { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" instance_seqno: 1786143129156280 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:52:09.436312 4219 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:52:09.437255 4342 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92bb089b2a742d9956f0cba5b711655 in term 1.
I20260807 22:52:09.438644 4456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:52:09.438948 4456 raft_consensus.cc:686] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [term 1 LEADER]: Becoming Leader. State: Replica: a92bb089b2a742d9956f0cba5b711655, State: Running, Role: LEADER
I20260807 22:52:09.439316 4456 consensus_queue.cc:237] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } }
I20260807 22:52:09.440138 4486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } } }
I20260807 22:52:09.440267 4486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 22:52:09.440945 4497 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:52:09.441066 4497 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 22:52:09.441332 4485 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260807 22:52:09.441375 4467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } } }
W20260807 22:52:09.441458 4485 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:52:09.441640 4376 master_runner.cc:263] No leader master found from master 76ed184be9ef4b6f9d2e5ffa96dc3da2
I20260807 22:52:09.441496 4467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:09.441697 4376 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:52:09.443519 4498 sys_catalog.cc:455] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a92bb089b2a742d9956f0cba5b711655. Latest consensus state: current_term: 1 leader_uuid: "a92bb089b2a742d9956f0cba5b711655" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } } }
I20260807 22:52:09.443657 4498 sys_catalog.cc:458] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:09.453214 4503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:52:09.455299 4503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:52:09.468246 4453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.444583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52320 (local address 127.12.112.252:42089)
0807 22:52:09.444724 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.444731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.450811 (+ 6080us) server_negotiation.cc:407] Connection header received
0807 22:52:09.451090 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.451093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.451141 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.451195 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.455236 (+ 4041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.456005 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.457143 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.457504 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.457579 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.461717 (+ 4138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.461721 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.461724 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.461751 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.463722 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.466378 (+ 2656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.466383 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.466385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.466474 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.466765 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.466768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.466770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.467239 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.467606 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.467953 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.468081 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:52:09.470295 4293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.443484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59676 (local address 127.12.112.254:38469)
0807 22:52:09.443626 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.443630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.450076 (+ 6446us) server_negotiation.cc:407] Connection header received
0807 22:52:09.450272 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.450276 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.450362 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.450416 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.451996 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.452797 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.462407 (+ 9610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.462764 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.462844 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.466542 (+ 3698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.466546 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.466548 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.466576 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.468156 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.468996 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.469000 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.469002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.469089 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.469377 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.469380 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.469382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.469594 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.469699 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.470030 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.470148 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:52:09.474002 4374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:09.444052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59258 (local address 127.12.112.253:33667)
0807 22:52:09.444172 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.444176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.450595 (+ 6419us) server_negotiation.cc:407] Connection header received
0807 22:52:09.451341 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.451344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.451392 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.451443 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.453267 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.454038 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.457737 (+ 3699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:09.458147 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:09.458227 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:09.464239 (+ 6012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:52:09.464243 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:52:09.464246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:52:09.464272 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:52:09.465953 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.472622 (+ 6669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.472625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.472627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.472721 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:52:09.473044 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:52:09.473048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:52:09.473050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:52:09.473273 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:52:09.473390 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:09.473726 (+ 336us) server_negotiation.cc:299] Negotiation successful
0807 22:52:09.473849 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:52:09.479523 4420 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [term 1 FOLLOWER]: Refusing update from remote peer a92bb089b2a742d9956f0cba5b711655: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:52:09.480238 4498 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:52:09.486860 4467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a92bb089b2a742d9956f0cba5b711655. Latest consensus state: current_term: 1 leader_uuid: "a92bb089b2a742d9956f0cba5b711655" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } } }
I20260807 22:52:09.486977 4467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:09.487998 4342 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [term 1 FOLLOWER]: Refusing update from remote peer a92bb089b2a742d9956f0cba5b711655: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:52:09.488612 4498 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:52:09.495211 4486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a92bb089b2a742d9956f0cba5b711655. Latest consensus state: current_term: 1 leader_uuid: "a92bb089b2a742d9956f0cba5b711655" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } } }
I20260807 22:52:09.495311 4486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:09.499857 4498 sys_catalog.cc:455] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a92bb089b2a742d9956f0cba5b711655" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } } }
I20260807 22:52:09.499965 4498 sys_catalog.cc:458] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:09.501169 4486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a92bb089b2a742d9956f0cba5b711655" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } } }
I20260807 22:52:09.501288 4486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:09.503880 4506 mvcc.cc:205] Tried to move back new op lower bound from 7316042258317271040 to 7316042258194669568. Current Snapshot: MvccSnapshot[applied={T|T < 7316042258317271040}]
I20260807 22:52:09.505481 4509 mvcc.cc:205] Tried to move back new op lower bound from 7316042258317271040 to 7316042258194669568. Current Snapshot: MvccSnapshot[applied={T|T < 7316042258317271040}]
I20260807 22:52:09.506222 4456 sys_catalog.cc:455] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a92bb089b2a742d9956f0cba5b711655" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } } }
I20260807 22:52:09.506349 4456 sys_catalog.cc:458] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655 [sys.catalog]: This master's current role is: LEADER
I20260807 22:52:09.507277 4467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a92bb089b2a742d9956f0cba5b711655" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92bb089b2a742d9956f0cba5b711655" member_type: VOTER last_known_addr { host: "127.12.112.254" port: 38469 } } peers { permanent_uuid: "3b57812ae9f94ee8a7dfb9962afb9005" member_type: VOTER last_known_addr { host: "127.12.112.253" port: 33667 } } peers { permanent_uuid: "76ed184be9ef4b6f9d2e5ffa96dc3da2" member_type: VOTER last_known_addr { host: "127.12.112.252" port: 42089 } } }
I20260807 22:52:09.507380 4467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:52:09.510728 4503 catalog_manager.cc:1347] Generated new cluster ID: 5f4f3f0f3b4242ae9ee872e4b7a5dd98
I20260807 22:52:09.510789 4503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:52:09.527236 4507 mvcc.cc:205] Tried to move back new op lower bound from 7316042258317271040 to 7316042258194669568. Current Snapshot: MvccSnapshot[applied={T|T < 7316042258317271040}]
I20260807 22:52:09.538327 4503 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:52:09.541628 4503 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:52:09.572237 4503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a92bb089b2a742d9956f0cba5b711655: Generated new TSK 0
I20260807 22:52:09.573135 4503 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:52:09.611166 4293 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.607537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59692 (local address 127.12.112.254:38469)
0807 22:52:09.607684 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.607689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.609691 (+ 2002us) server_negotiation.cc:407] Connection header received
0807 22:52:09.610149 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.610153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.610211 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.610269 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.611021 (+ 752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59692: BlockingRecv error: recv got EOF from 127.0.0.1:59692 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260807 22:52:09.612587 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.608349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59274 (local address 127.12.112.253:33667)
0807 22:52:09.608475 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.608480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.609917 (+ 1437us) server_negotiation.cc:407] Connection header received
0807 22:52:09.611748 (+ 1831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.611752 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.611806 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.611863 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.612448 (+ 585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59274: BlockingRecv error: recv got EOF from 127.0.0.1:59274 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 22:52:09.614524 4453 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.609115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52326 (local address 127.12.112.252:42089)
0807 22:52:09.609255 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.609260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.613363 (+ 4103us) server_negotiation.cc:407] Connection header received
0807 22:52:09.613623 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.613627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.613687 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.613746 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.614381 (+ 635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52326: BlockingRecv error: recv got EOF from 127.0.0.1:52326 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 22:52:09.619328 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.617567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59276 (local address 127.12.112.253:33667)
0807 22:52:09.617671 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.617675 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.618220 (+ 545us) server_negotiation.cc:407] Connection header received
0807 22:52:09.618506 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.618511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.618611 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.618678 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.619228 (+ 550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59276: BlockingRecv error: recv got EOF from 127.0.0.1:59276 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260807 22:52:09.624194 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.622787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59290 (local address 127.12.112.253:33667)
0807 22:52:09.622881 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.622885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.623372 (+ 487us) server_negotiation.cc:407] Connection header received
0807 22:52:09.623552 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.623555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.623600 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.623647 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.624100 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59290: BlockingRecv error: recv got EOF from 127.0.0.1:59290 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260807 22:52:09.629594 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.628130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59296 (local address 127.12.112.253:33667)
0807 22:52:09.628230 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.628233 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.628733 (+ 500us) server_negotiation.cc:407] Connection header received
0807 22:52:09.628913 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.628918 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.628973 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.629027 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.629488 (+ 461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59296: BlockingRecv error: recv got EOF from 127.0.0.1:59296 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260807 22:52:09.637382 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.635781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59304 (local address 127.12.112.253:33667)
0807 22:52:09.635906 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.635910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.636463 (+ 553us) server_negotiation.cc:407] Connection header received
0807 22:52:09.636668 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.636671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.636721 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.636769 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.637267 (+ 498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59304: BlockingRecv error: recv got EOF from 127.0.0.1:59304 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260807 22:52:09.649266 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.647582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59320 (local address 127.12.112.253:33667)
0807 22:52:09.647685 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.647689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.648233 (+ 544us) server_negotiation.cc:407] Connection header received
0807 22:52:09.648434 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.648438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.648507 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.648562 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.649157 (+ 595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59320: BlockingRecv error: recv got EOF from 127.0.0.1:59320 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260807 22:52:09.668663 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.667555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59336 (local address 127.12.112.253:33667)
0807 22:52:09.667691 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.667696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.667846 (+ 150us) server_negotiation.cc:407] Connection header received
0807 22:52:09.667974 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.667977 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.668026 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.668089 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.668528 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59336: BlockingRecv error: recv got EOF from 127.0.0.1:59336 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 22:52:09.703965 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.702668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59346 (local address 127.12.112.253:33667)
0807 22:52:09.702843 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.702849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.703053 (+ 204us) server_negotiation.cc:407] Connection header received
0807 22:52:09.703229 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.703232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.703282 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.703384 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.703864 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59346: BlockingRecv error: recv got EOF from 127.0.0.1:59346 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 22:52:09.771425 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.770193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59360 (local address 127.12.112.253:33667)
0807 22:52:09.770372 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.770377 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.770525 (+ 148us) server_negotiation.cc:407] Connection header received
0807 22:52:09.770701 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.770704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.770753 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.770854 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.771306 (+ 452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59360: BlockingRecv error: recv got EOF from 127.0.0.1:59360 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 22:52:09.902698 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:09.901517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59364 (local address 127.12.112.253:33667)
0807 22:52:09.901646 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:09.901650 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:09.901789 (+ 139us) server_negotiation.cc:407] Connection header received
0807 22:52:09.901929 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:09.901931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:09.901982 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:09.902060 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:09.902506 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59364: BlockingRecv error: recv got EOF from 127.0.0.1:59364 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 22:52:10.162164 4374 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:52:10.160867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59378 (local address 127.12.112.253:33667)
0807 22:52:10.161033 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:10.161039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:10.161197 (+ 158us) server_negotiation.cc:407] Connection header received
0807 22:52:10.161366 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:10.161370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:10.161417 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:10.161504 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:52:10.162003 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59378: BlockingRecv error: recv got EOF from 127.0.0.1:59378 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:52:10.442413 4497 catalog_manager.cc:1259] Loaded cluster ID: 5f4f3f0f3b4242ae9ee872e4b7a5dd98
I20260807 22:52:10.442497 4497 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005: loading cluster ID for follower catalog manager: success
I20260807 22:52:10.443060 4485 catalog_manager.cc:1259] Loaded cluster ID: 5f4f3f0f3b4242ae9ee872e4b7a5dd98
I20260807 22:52:10.443145 4485 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2: loading cluster ID for follower catalog manager: success
I20260807 22:52:10.444240 4497 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005: acquiring CA information for follower catalog manager: success
I20260807 22:52:10.444670 4485 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2: acquiring CA information for follower catalog manager: success
I20260807 22:52:10.445382 4497 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3b57812ae9f94ee8a7dfb9962afb9005: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:52:10.445704 4485 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 76ed184be9ef4b6f9d2e5ffa96dc3da2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:52:10.680611 4582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:10.676794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59388 (local address 127.12.112.253:33667)
0807 22:52:10.677090 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:10.677094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:10.677111 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:52:10.677261 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:10.677263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:10.677394 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:10.677502 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:52:10.677727 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:10.678248 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:10.679108 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:10.679323 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:10.679397 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:10.679663 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:52:10.680198 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:52:10.680291 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:10.680366 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 22:52:10.680413 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":118,"threads_started":1}
I20260807 22:52:10.686826 4588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:10.683596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52342 (local address 127.12.112.252:42089)
0807 22:52:10.683866 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:10.683870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:10.683883 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:52:10.683954 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:10.683956 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:10.684057 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:10.684146 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:52:10.684326 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:10.684823 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:10.685577 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:10.685780 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:10.685851 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:10.686077 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:52:10.686459 (+ 382us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:52:10.686553 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:10.686600 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 22:52:10.686643 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":114,"threads_started":1}
I20260807 22:52:10.693652 4588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:10.689690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52356 (local address 127.12.112.252:42089)
0807 22:52:10.689787 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:10.689790 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:10.690325 (+ 535us) server_negotiation.cc:407] Connection header received
0807 22:52:10.690374 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:10.690376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:10.690420 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:10.690482 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:52:10.690820 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:10.691594 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:10.692545 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:10.692797 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:10.692889 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:10.693218 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:52:10.693291 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:52:10.693381 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:10.693477 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 22:52:10.693522 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 22:52:10.694087 4582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:10.689945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59400 (local address 127.12.112.253:33667)
0807 22:52:10.690204 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:10.690210 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:10.690465 (+ 255us) server_negotiation.cc:407] Connection header received
0807 22:52:10.690653 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:10.690656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:10.690706 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:10.690753 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:52:10.691104 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:10.691591 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:10.692798 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:10.693119 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:10.693221 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:10.693587 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:52:10.693660 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:52:10.693708 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:10.693897 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 22:52:10.693980 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183}
I20260807 22:52:10.694553 4595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:52:10.689843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59694 (local address 127.12.112.254:38469)
0807 22:52:10.690293 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0807 22:52:10.690317 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 22:52:10.690330 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:52:10.690407 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:52:10.690411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:52:10.690553 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:52:10.690662 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:52:10.691003 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:10.691791 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:10.692885 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:52:10.693131 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:52:10.693253 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:52:10.693624 (+ 371us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:52:10.693913 (+ 289us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:52:10.694009 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 22:52:10.694320 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 22:52:10.694385 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":89,"threads_started":1}
I20260807 22:52:10.697583 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 4219
I20260807 22:52:10.706113 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 4297
I20260807 22:52:10.712791 12739 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksZtO5S/build/debug/bin/kudu with pid 4376
2026-08-07T22:52:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3152 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6225 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (286982 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST